Jul 06 19:25:48.136410 ip-10-0-136-35 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.495073 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501454 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501466 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501469 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501472 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501475 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501478 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501481 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:48.632764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501483 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:48.568862 ip-10-0-136-35 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501486 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501489 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501491 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501493 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501496 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501499 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501502 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501504 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501507 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501516 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501519 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501521 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501524 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501526 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501529 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501531 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501534 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501536 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501539 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:48.646111 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501541 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501544 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501546 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501549 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501552 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501555 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501557 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501560 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501562 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501565 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501568 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501570 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501572 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501575 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501579 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501582 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501585 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501588 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501591 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:48.646899 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501594 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501596 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501599 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501601 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501604 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501606 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501609 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501612 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501615 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501617 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501620 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501622 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501626 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501628 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501631 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501633 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501636 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501638 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501640 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501643 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:48.648963 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501645 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501648 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501652 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501656 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501659 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501662 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501665 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501667 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501671 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501673 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501676 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501678 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501680 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501683 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501685 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501688 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501690 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501693 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501697 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:48.650920 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501700 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501703 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501706 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501708 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501711 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501713 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501716 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501718 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501720 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501723 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501725 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501727 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501730 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.501732 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502892 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502900 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502903 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502906 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502909 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502912 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:48.651916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502915 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502918 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502921 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502924 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502927 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502929 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502932 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502934 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502937 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502939 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502942 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502944 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502948 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502950 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502952 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502955 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502957 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502960 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502962 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:48.653669 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502964 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502967 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502969 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502972 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502974 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502976 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502979 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502981 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502987 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502990 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502992 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502995 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.502998 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503001 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503003 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503006 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503009 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503013 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503015 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503017 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:48.656005 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503020 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503022 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503025 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503027 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503030 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503033 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503035 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503038 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503040 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503042 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503045 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503047 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503050 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503052 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503054 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503057 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503059 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503062 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503065 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503068 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:48.658083 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503072 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503075 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503077 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503080 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503082 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503085 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503087 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503090 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503092 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503096 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503099 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503102 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503105 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503108 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503111 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503114 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503116 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503120 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503122 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503125 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:48.658839 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503128 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503130 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503134 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503137 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503139 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503156 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503159 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503161 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503164 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503166 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503169 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503172 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503175 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503178 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503535 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503541 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503544 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503547 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503550 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:48.660857 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503552 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503555 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503557 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503560 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503562 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503566 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503570 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503573 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503576 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503579 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503589 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503592 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503594 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503597 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503600 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503602 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503604 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503607 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503609 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:48.662221 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503612 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503614 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503616 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503619 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503621 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503624 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503629 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503631 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503634 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503636 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503639 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503641 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503644 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503647 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503649 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503651 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503654 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503656 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503658 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503664 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:48.663502 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503666 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503669 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503671 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503674 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503682 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503684 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503687 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503689 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503692 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503694 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503697 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503699 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503702 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503704 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503707 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503709 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503711 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503714 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503718 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:48.664398 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503720 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503723 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503725 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503728 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503731 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503733 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503736 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503738 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503740 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503743 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503745 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503747 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503751 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503754 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503756 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503758 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503761 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503763 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503769 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503772 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:48.665000 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503774 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503778 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503781 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503784 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503787 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503789 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503792 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503795 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503798 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503801 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503803 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503807 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503810 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503812 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503815 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.503818 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503877 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503884 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503890 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503894 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503897 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:25:48.665607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503900 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503905 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503908 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503913 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503915 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503919 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503922 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503925 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503928 2563 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503931 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503940 2563 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503943 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503945 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503951 2563 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503954 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503957 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503960 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503963 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503966 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503969 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503972 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503975 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503980 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503982 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:25:48.666418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503985 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503988 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503991 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503995 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.503997 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504000 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504003 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504005 2563 flags.go:64] FLAG: --enable-server="true" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504008 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504015 2563 flags.go:64] FLAG: --event-burst="100" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504018 2563 flags.go:64] FLAG: --event-qps="50" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504021 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504024 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504027 2563 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504030 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504033 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504036 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504038 2563 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504041 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504049 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504053 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504055 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504058 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504061 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504063 2563 flags.go:64] FLAG: --feature-gates="" Jul 06 19:25:48.667214 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504067 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504070 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504072 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504075 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504078 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504082 2563 flags.go:64] FLAG: --help="false" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504085 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-35.ec2.internal" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504088 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504090 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504093 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504096 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504100 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504102 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504105 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504108 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504110 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504113 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504116 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504120 2563 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504123 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504125 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504128 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504157 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504176 2563 flags.go:64] FLAG: --lock-file="" Jul 06 19:25:48.667955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504182 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504186 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504190 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504202 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504206 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504209 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504212 2563 flags.go:64] FLAG: --logging-format="text" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504215 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504219 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504222 2563 flags.go:64] FLAG: --manifest-url="" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504225 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504229 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504235 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504239 2563 flags.go:64] FLAG: --max-pods="110" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504242 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504245 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504248 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504251 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504254 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504257 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504260 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504267 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504270 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504273 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:25:48.668643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504276 2563 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504279 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504285 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504288 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504291 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504294 2563 flags.go:64] FLAG: --port="10250" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504297 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504300 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f83770628641ca2e" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504304 2563 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504307 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504310 2563 flags.go:64] FLAG: --register-node="true" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504313 2563 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504317 2563 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504320 2563 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504322 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504325 2563 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504328 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504331 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504335 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504337 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504340 2563 flags.go:64] FLAG: --runonce="false" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504344 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504347 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504350 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504353 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:25:48.669672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504356 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504359 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504362 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504365 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504368 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504370 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504373 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504379 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504382 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504386 2563 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504389 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504394 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504397 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504400 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504405 2563 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504408 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504411 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504414 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504416 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504419 2563 flags.go:64] FLAG: --v="2" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504423 2563 flags.go:64] FLAG: --version="false" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504426 2563 flags.go:64] FLAG: --vmodule="" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504430 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.504433 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:25:48.670370 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504583 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504589 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504592 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504595 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504597 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504600 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504603 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504605 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504610 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504612 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504615 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504617 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504620 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504623 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504625 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504629 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504631 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504634 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504637 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:48.838061 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504640 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504642 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504645 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504648 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504650 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504653 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504655 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504658 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504660 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504663 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504666 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504668 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504671 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504673 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504676 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504678 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504681 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504683 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504685 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504688 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:48.854448 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504691 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504697 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504700 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504703 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504706 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504708 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504712 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504716 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504721 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504724 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504727 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504730 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504732 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504735 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504738 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504740 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504743 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504746 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504749 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:48.855069 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504751 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504754 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504756 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504759 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504761 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504763 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504766 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504768 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504771 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504774 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504776 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504779 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504781 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504784 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504788 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504790 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504793 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504795 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504798 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504800 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:48.855647 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504803 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504806 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504809 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504811 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504814 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504816 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504819 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504821 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504823 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504826 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504828 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504831 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504833 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504836 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504838 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504841 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504843 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504846 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504848 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:48.856188 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504851 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.504853 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.505594 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.513696 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.513711 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.513726 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.513735 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513789 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513794 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513798 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513801 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513804 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513807 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513810 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513812 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:48.856735 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513815 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513817 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513822 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513826 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513829 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513831 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513834 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513837 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513840 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513843 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513846 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513849 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513851 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513854 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513856 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513859 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513862 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513864 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513867 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513870 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:48.857172 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513873 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513876 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513878 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513881 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513883 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513886 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513888 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513893 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513896 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513898 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513901 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513903 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513906 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513909 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513911 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513914 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513916 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513919 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513921 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:48.857820 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513924 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513928 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513931 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513934 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513937 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513940 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513942 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513945 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513951 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513954 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513956 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513959 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513961 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513964 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513966 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513969 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513971 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513974 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513976 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513978 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:48.858351 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513982 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513984 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513988 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513992 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513994 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513997 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.513999 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514002 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514004 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514007 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514009 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514011 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514015 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514018 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514020 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514022 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514025 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514027 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514030 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:48.858929 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514032 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514036 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514038 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514041 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514044 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514047 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514049 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514051 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514054 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514056 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514059 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514061 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514064 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.514070 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514198 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:25:48.859446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514203 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514206 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514209 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514211 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514214 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514216 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514219 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514221 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514224 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514226 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514229 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514232 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514235 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514237 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514239 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514242 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514244 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514246 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514249 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514253 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:25:48.859890 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514256 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514258 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514260 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514263 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514267 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514270 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514274 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514277 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514280 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514283 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514287 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514291 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514294 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514297 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514299 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514302 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514304 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514307 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:25:48.860431 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514309 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514312 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514314 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514317 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514319 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514322 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514324 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514327 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514329 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514332 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514334 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514336 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514339 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514342 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514345 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514347 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514350 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514352 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514355 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514357 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:25:48.860993 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514360 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514362 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514365 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514367 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514371 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514373 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514376 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514378 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514381 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514383 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514385 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514388 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514390 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514393 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514395 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514398 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514400 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514402 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514405 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514411 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:25:48.861612 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514413 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514416 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514419 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514421 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514423 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514427 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514430 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514432 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514434 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514437 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514439 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514442 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514444 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514447 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514449 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514452 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514456 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514458 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514460 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:25:48.862446 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:48.514463 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.514468 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.514570 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.519238 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.520441 2563 server.go:1019] "Starting client certificate rotation" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.520538 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.520567 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.522646 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.526889 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.534871 2563 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.538833 2563 log.go:25] "Validated CRI v1 image API" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.539607 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:25:48.863040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.543478 2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 928bdb9e-0304-4e48-984d-df71e38cc68d:/dev/nvme0n1p4 de675b70-4c91-489e-ac24-8e21715ba3b3:/dev/nvme0n1p3] Jul 06 19:25:48.863442 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.543494 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:25:48.863645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.550384 2563 manager.go:216] Machine: {Timestamp:2026-07-06 19:25:48.549108881 +0000 UTC m=+0.306278362 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199697 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e5c2c8e6d6e67b2fefeab96a3f517 SystemUUID:ec2e5c2c-8e6d-6e67-b2fe-feab96a3f517 BootID:92f864d3-8520-46d0-9b8e-621b67391cf3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:16:b4:25:d5:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:16:b4:25:d5:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:00:d2:e0:8b:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:25:48.863645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.550483 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:25:48.863645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.550551 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:25:48.863645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.551046 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:25:48.863645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.552065 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:25:48.863645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.552085 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:25:48.863645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.552707 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.552722 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.552729 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.553285 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.554486 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.557347 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.557470 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.557496 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.557512 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.557545 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.557556 2563 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.557569 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.558346 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.558380 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.562178 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.564010 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.564037 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.564966 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.564980 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.564985 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.564990 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.564999 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565004 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565012 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565017 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565024 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565030 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565037 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565043 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565063 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.565069 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.567859 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.567997 2563 server.go:1268] "Started kubelet" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.568075 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.568103 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.568160 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.568812 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.568905 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.569938 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.570718 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:25:48.864049 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.573624 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.573795 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-35.ec2.internal.18bfc9e1acebedb9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-35.ec2.internal,UID:ip-10-0-136-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-35.ec2.internal,},FirstTimestamp:2026-07-06 19:25:48.567973305 +0000 UTC m=+0.325142785,LastTimestamp:2026-07-06 19:25:48.567973305 +0000 UTC m=+0.325142785,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-35.ec2.internal,}" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575121 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ktsqv" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575163 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575171 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.575235 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575622 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575665 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575675 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575759 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.575768 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576038 2563 factory.go:55] Registering systemd factory Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576052 2563 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576306 2563 factory.go:153] Registering CRI-O factory Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576319 2563 factory.go:223] Registration of the crio container factory successfully Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576365 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576397 2563 factory.go:103] Registering Raw factory Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576411 2563 manager.go:1196] Started watching for new ooms in manager Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.576846 2563 manager.go:349] Starting recovery of all containers Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.583820 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ktsqv" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.584943 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.585055 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.586170 2563 manager.go:354] Recovery completed Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.592410 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.594004 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.594036 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.594051 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.594473 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.594484 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.594493 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.594500 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.595068 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:48.865419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.595092 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.595102 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.595673 2563 policy_none.go:49] "None policy: Start" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.595687 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.595696 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.596859 2563 policy_none.go:47] "Start" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.642700 2563 manager.go:337] "Starting Device Plugin manager" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.642725 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.642734 2563 server.go:87] "Starting device plugin registration server" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.642907 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.642917 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.643014 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.643084 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.643092 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.643402 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.643442 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.743489 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.745830 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.745849 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.745860 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.745882 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-35.ec2.internal" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.752259 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-35.ec2.internal" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.752274 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-35.ec2.internal\": node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.767685 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.800364 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.804411 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.804445 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.804473 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.804514 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:25:48.866331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.807249 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.868279 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.904581 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal"] Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.904629 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.905522 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.905548 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.905559 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.907014 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.907132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.907170 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.907699 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.907720 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.907737 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.908225 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.908248 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.908257 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.909754 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.909775 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.910397 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.910413 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:48.910421 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.946581 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-35.ec2.internal\" not found" node="ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.950702 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-35.ec2.internal\" not found" node="ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.041921 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:48.968709 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:49.069050 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.076853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aecee05319c003e574ec53a14a8ebc17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal\" (UID: \"aecee05319c003e574ec53a14a8ebc17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.076878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b47fecc3bc6b998318376f0c89d44556-config\") pod \"kube-apiserver-proxy-ip-10-0-136-35.ec2.internal\" (UID: \"b47fecc3bc6b998318376f0c89d44556\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.076902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aecee05319c003e574ec53a14a8ebc17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal\" (UID: \"aecee05319c003e574ec53a14a8ebc17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:49.176575 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.177790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b47fecc3bc6b998318376f0c89d44556-config\") pod \"kube-apiserver-proxy-ip-10-0-136-35.ec2.internal\" (UID: \"b47fecc3bc6b998318376f0c89d44556\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.177811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aecee05319c003e574ec53a14a8ebc17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal\" (UID: \"aecee05319c003e574ec53a14a8ebc17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.177830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aecee05319c003e574ec53a14a8ebc17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal\" (UID: \"aecee05319c003e574ec53a14a8ebc17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.177855 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aecee05319c003e574ec53a14a8ebc17-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal\" (UID: \"aecee05319c003e574ec53a14a8ebc17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.177873 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/aecee05319c003e574ec53a14a8ebc17-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal\" (UID: \"aecee05319c003e574ec53a14a8ebc17\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.177891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b47fecc3bc6b998318376f0c89d44556-config\") pod \"kube-apiserver-proxy-ip-10-0-136-35.ec2.internal\" (UID: \"b47fecc3bc6b998318376f0c89d44556\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.254799 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.265576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.254841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.454176 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:49.292820 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.454176 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:49.393381 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.700479 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:49.494742 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.700479 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.522250 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:25:49.700479 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.522380 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:25:49.700479 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.586362 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:20:49 +0000 UTC" deadline="2027-12-14 09:23:16.249489555 +0000 UTC" Jul 06 19:25:49.700479 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.586395 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12613h57m26.663099331s" Jul 06 19:25:49.700479 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:49.595406 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.700479 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:49.696350 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-35.ec2.internal\" not found" Jul 06 19:25:49.889866 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.759729 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:49.889866 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.780557 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.889866 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.797946 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:25:49.889866 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.799927 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" Jul 06 19:25:49.889866 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:49.808660 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:25:50.103844 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:50.044631 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47fecc3bc6b998318376f0c89d44556.slice/crio-cbb99054fb50b3ca928612c1c28ec7be6780cce015079545439c4a67bcc7c475 WatchSource:0}: Error finding container cbb99054fb50b3ca928612c1c28ec7be6780cce015079545439c4a67bcc7c475: Status 404 returned error can't find the container with id cbb99054fb50b3ca928612c1c28ec7be6780cce015079545439c4a67bcc7c475 Jul 06 19:25:50.103844 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:50.045125 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaecee05319c003e574ec53a14a8ebc17.slice/crio-d7007086c8e1e500a3f4b30a8463a761e9008e38e793e0f63e25357f9616a561 WatchSource:0}: Error finding container d7007086c8e1e500a3f4b30a8463a761e9008e38e793e0f63e25357f9616a561: Status 404 returned error can't find the container with id d7007086c8e1e500a3f4b30a8463a761e9008e38e793e0f63e25357f9616a561 Jul 06 19:25:50.103844 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.050527 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:25:50.260895 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.119139 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:50.260895 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.137534 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:50.564975 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.560464 2563 apiserver.go:52] "Watching apiserver" Jul 06 19:25:50.575184 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.571196 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:25:50.575184 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.571739 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-9dfnc","openshift-network-operator/iptables-alerter-5867w","openshift-ovn-kubernetes/ovnkube-node-mhfxv","kube-system/konnectivity-agent-b22w2","kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt","openshift-cluster-node-tuning-operator/tuned-6p4mv","openshift-dns/node-resolver-rrngf","openshift-image-registry/node-ca-qpk58","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal","openshift-multus/multus-vrrff","kube-system/global-pull-secret-syncer-kp5tk","openshift-multus/multus-additional-cni-plugins-c4bzz","openshift-multus/network-metrics-daemon-fg2cc"] Jul 06 19:25:50.575184 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.574547 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.577023 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.576241 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:25:50.578162 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.577042 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.578162 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.578098 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:50.581135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.578473 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vvzlc\"" Jul 06 19:25:50.581135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.578694 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:50.581135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.579018 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:25:50.581135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.579260 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6bf7x\"" Jul 06 19:25:50.581135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.579455 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:25:50.581135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.579871 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:25:50.581135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.580193 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.582333 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.581315 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:25:50.586262 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.583690 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:50.586262 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586102 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ndfl6\"" Jul 06 19:25:50.586262 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586168 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586106 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586377 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586510 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586557 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586666 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586741 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586820 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wnr5b\"" Jul 06 19:25:50.589379 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.586928 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:25:50.590304 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.589700 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:25:50.590304 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.589994 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:50.590304 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.590055 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.593640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.596157 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6hw9n\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.596384 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.596585 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.596641 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.597206 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.599392 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.599881 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jghw7\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.600211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.600621 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.600846 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.601969 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.602275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7gjz4\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.602328 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.602633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.604799 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.604847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.605235 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rbtgk\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.605589 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.605646 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.607818 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.607980 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.608179 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sgjxf\"" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.612964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-kubelet\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613454 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-modprobe-d\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613487 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-run\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.656004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613508 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce80c087-4543-45f0-8ad7-fba963fd9023-tmp\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fbn8\" (UniqueName: \"kubernetes.io/projected/ce80c087-4543-45f0-8ad7-fba963fd9023-kube-api-access-8fbn8\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-cnibin\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613741 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-hostroot\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-host\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysctl-d\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-sys\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613821 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-system-cni-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-cni-bin\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613875 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-conf-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-multus-certs\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysconfig\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.613975 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-kubernetes\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-etc-kubernetes\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.659166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-systemd\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-cni-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-os-release\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwmqt\" (UniqueName: \"kubernetes.io/projected/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-kube-api-access-hwmqt\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-socket-dir-parent\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysctl-conf\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614244 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-lib-modules\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-tuned\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-cni-multus\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-var-lib-kubelet\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614376 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-k8s-cni-cncf-io\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-netns\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614442 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-daemon-config\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.614887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-cni-binary-copy\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.615341 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-csgn4" Jul 06 19:25:50.660345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.615993 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:50.663024 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.616057 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:25:50.663024 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.629073 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-csgn4" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-cnibin\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715076 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715095 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-dbus\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715146 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f8z\" (UniqueName: \"kubernetes.io/projected/b46beeee-2a96-4b26-81ce-469ff50b810c-kube-api-access-58f8z\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715233 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-lib-modules\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w76zm\" (UniqueName: \"kubernetes.io/projected/16032533-6dfb-4784-b7e5-ae615d9f64a0-kube-api-access-w76zm\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-run-netns\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715423 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-socket-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715429 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-lib-modules\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bfdae79-1660-45da-bd6e-1eb9d9553e51-host\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.748867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-etc-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715586 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-cni-bin\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qjx\" (UniqueName: \"kubernetes.io/projected/2dc6a353-8356-4f38-bce0-bad1793051e4-kube-api-access-92qjx\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-kubelet\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-slash\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715705 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-kubelet\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715733 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-modprobe-d\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-run\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce80c087-4543-45f0-8ad7-fba963fd9023-tmp\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-hostroot\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715828 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-modprobe-d\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovnkube-config\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715864 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-host\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.750561 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysctl-d\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-system-cni-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715935 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-cni-bin\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-multus-certs\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.715979 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-etc-kubernetes\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-systemd-units\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716030 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysconfig\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-kubernetes\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716128 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16032533-6dfb-4784-b7e5-ae615d9f64a0-tmp-dir\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716149 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-kubelet\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-systemd\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-run\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.753099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716241 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e99d4fe8-7e7b-446d-a097-e0c8a14f0f07-konnectivity-ca\") pod \"konnectivity-agent-b22w2\" (UID: \"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07\") " pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-etc-kubernetes\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716291 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9566z\" (UniqueName: \"kubernetes.io/projected/354bf0ef-82fe-4d92-90b0-6b520909ada7-kube-api-access-9566z\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716320 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-hostroot\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-systemd\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716373 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-host\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716377 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-cni-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwmqt\" (UniqueName: \"kubernetes.io/projected/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-kube-api-access-hwmqt\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16032533-6dfb-4784-b7e5-ae615d9f64a0-hosts-file\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716542 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-cni-bin\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716512 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-system-cni-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-var-lib-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-node-log\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-multus-certs\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.754264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovn-node-metrics-cert\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b46beeee-2a96-4b26-81ce-469ff50b810c-iptables-alerter-script\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-socket-dir-parent\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716723 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-registration-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bfdae79-1660-45da-bd6e-1eb9d9553e51-serviceca\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtqhl\" (UniqueName: \"kubernetes.io/projected/5bfdae79-1660-45da-bd6e-1eb9d9553e51-kube-api-access-jtqhl\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-kubelet-config\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716828 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-ovn\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovnkube-script-lib\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716905 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysctl-conf\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-tuned\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-cni-multus\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.758458 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-log-socket\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717067 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-system-cni-dir\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-os-release\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-var-lib-kubelet\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-k8s-cni-cncf-io\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717169 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-netns\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717219 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-daemon-config\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-cni-binary-copy\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-device-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717340 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-sys-fs\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqvtt\" (UniqueName: \"kubernetes.io/projected/34d3de0a-cfe4-4734-a8e1-679c97b90510-kube-api-access-lqvtt\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fbn8\" (UniqueName: \"kubernetes.io/projected/ce80c087-4543-45f0-8ad7-fba963fd9023-kube-api-access-8fbn8\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-cnibin\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.759633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvlst\" (UniqueName: \"kubernetes.io/projected/42062fcb-33f6-47fb-a7af-6a967ada6e86-kube-api-access-hvlst\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-kubernetes\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717616 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-var-lib-kubelet\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717652 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-k8s-cni-cncf-io\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717689 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-run-netns\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717696 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-cni-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.716470 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysctl-d\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-socket-dir-parent\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-sys\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-conf-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717890 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e99d4fe8-7e7b-446d-a097-e0c8a14f0f07-agent-certs\") pod \"konnectivity-agent-b22w2\" (UID: \"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07\") " pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b46beeee-2a96-4b26-81ce-469ff50b810c-host-slash\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-os-release\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.762783 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.717998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-cni-netd\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718070 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysconfig\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718127 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-env-overrides\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718279 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-daemon-config\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-sysctl-conf\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718451 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-host-var-lib-cni-multus\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718495 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-sys\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718533 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-multus-conf-dir\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718587 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-cnibin\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-cni-binary-copy\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718655 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-systemd\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718712 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-os-release\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.718849 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.719231 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.719332 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.724308 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ce80c087-4543-45f0-8ad7-fba963fd9023-etc-tuned\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.763712 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.724763 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce80c087-4543-45f0-8ad7-fba963fd9023-tmp\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.726760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwmqt\" (UniqueName: \"kubernetes.io/projected/1dc2201e-7673-4cfe-a44b-cc2c7d764eae-kube-api-access-hwmqt\") pod \"multus-vrrff\" (UID: \"1dc2201e-7673-4cfe-a44b-cc2c7d764eae\") " pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.730650 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fbn8\" (UniqueName: \"kubernetes.io/projected/ce80c087-4543-45f0-8ad7-fba963fd9023-kube-api-access-8fbn8\") pod \"tuned-6p4mv\" (UID: \"ce80c087-4543-45f0-8ad7-fba963fd9023\") " pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.776865 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-dbus\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818813 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f8z\" (UniqueName: \"kubernetes.io/projected/b46beeee-2a96-4b26-81ce-469ff50b810c-kube-api-access-58f8z\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76zm\" (UniqueName: \"kubernetes.io/projected/16032533-6dfb-4784-b7e5-ae615d9f64a0-kube-api-access-w76zm\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-run-netns\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-socket-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bfdae79-1660-45da-bd6e-1eb9d9553e51-host\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-etc-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.829927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-cni-bin\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.818993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92qjx\" (UniqueName: \"kubernetes.io/projected/2dc6a353-8356-4f38-bce0-bad1793051e4-kube-api-access-92qjx\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819017 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-slash\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819046 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovnkube-config\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-systemd-units\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16032533-6dfb-4784-b7e5-ae615d9f64a0-tmp-dir\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-kubelet\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-systemd\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e99d4fe8-7e7b-446d-a097-e0c8a14f0f07-konnectivity-ca\") pod \"konnectivity-agent-b22w2\" (UID: \"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07\") " pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9566z\" (UniqueName: \"kubernetes.io/projected/354bf0ef-82fe-4d92-90b0-6b520909ada7-kube-api-access-9566z\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819300 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16032533-6dfb-4784-b7e5-ae615d9f64a0-hosts-file\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.830839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819306 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-etc-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-var-lib-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-node-log\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819368 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovn-node-metrics-cert\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819389 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b46beeee-2a96-4b26-81ce-469ff50b810c-iptables-alerter-script\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-registration-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bfdae79-1660-45da-bd6e-1eb9d9553e51-serviceca\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819455 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtqhl\" (UniqueName: \"kubernetes.io/projected/5bfdae79-1660-45da-bd6e-1eb9d9553e51-kube-api-access-jtqhl\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-kubelet-config\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819514 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-ovn\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovnkube-script-lib\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819590 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819594 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-run-netns\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.831711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-dbus\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819724 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-cni-bin\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819754 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-log-socket\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5bfdae79-1660-45da-bd6e-1eb9d9553e51-host\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-system-cni-dir\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-os-release\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819854 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-slash\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-device-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-sys-fs\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819939 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqvtt\" (UniqueName: \"kubernetes.io/projected/34d3de0a-cfe4-4734-a8e1-679c97b90510-kube-api-access-lqvtt\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvlst\" (UniqueName: \"kubernetes.io/projected/42062fcb-33f6-47fb-a7af-6a967ada6e86-kube-api-access-hvlst\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819991 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e99d4fe8-7e7b-446d-a097-e0c8a14f0f07-agent-certs\") pod \"konnectivity-agent-b22w2\" (UID: \"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07\") " pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b46beeee-2a96-4b26-81ce-469ff50b810c-host-slash\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820090 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-cni-netd\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-env-overrides\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-cnibin\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820213 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-cnibin\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820269 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-cni-binary-copy\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.819725 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-socket-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-log-socket\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820465 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-system-cni-dir\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.833889 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820772 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovnkube-config\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820819 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-node-log\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-os-release\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820988 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-systemd-units\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821080 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-kubelet\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.821096 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821116 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-systemd\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.821178 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:51.321142583 +0000 UTC m=+3.078312078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821367 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-run-ovn-kubernetes\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/354bf0ef-82fe-4d92-90b0-6b520909ada7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.821492 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.821552 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret podName:eec73bb3-c96f-429a-9b5f-8a3bd35d6504 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:51.321535857 +0000 UTC m=+3.078705325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret") pod "global-pull-secret-syncer-kp5tk" (UID: "eec73bb3-c96f-429a-9b5f-8a3bd35d6504") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821677 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e99d4fe8-7e7b-446d-a097-e0c8a14f0f07-konnectivity-ca\") pod \"konnectivity-agent-b22w2\" (UID: \"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07\") " pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:50.835032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821736 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-device-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.820777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-var-lib-openvswitch\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-sys-fs\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821837 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b46beeee-2a96-4b26-81ce-469ff50b810c-host-slash\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821851 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/16032533-6dfb-4784-b7e5-ae615d9f64a0-hosts-file\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d3de0a-cfe4-4734-a8e1-679c97b90510-registration-dir\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-host-cni-netd\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.821940 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42062fcb-33f6-47fb-a7af-6a967ada6e86-run-ovn\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.822317 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-env-overrides\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.822377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-kubelet-config\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.822376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5bfdae79-1660-45da-bd6e-1eb9d9553e51-serviceca\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.822751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/354bf0ef-82fe-4d92-90b0-6b520909ada7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.822789 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovnkube-script-lib\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.822933 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16032533-6dfb-4784-b7e5-ae615d9f64a0-tmp-dir\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.823369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b46beeee-2a96-4b26-81ce-469ff50b810c-iptables-alerter-script\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.835951 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.823582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42062fcb-33f6-47fb-a7af-6a967ada6e86-ovn-node-metrics-cert\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.824038 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e99d4fe8-7e7b-446d-a097-e0c8a14f0f07-agent-certs\") pod \"konnectivity-agent-b22w2\" (UID: \"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07\") " pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.829333 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.829358 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.829377 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nmvv7 for pod openshift-network-diagnostics/network-check-target-9dfnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:50.829446 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7 podName:1953c5c9-8192-4e9e-b5da-5b5eb4369ee2 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:51.329431545 +0000 UTC m=+3.086601037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nmvv7" (UniqueName: "kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7") pod "network-check-target-9dfnc" (UID: "1953c5c9-8192-4e9e-b5da-5b5eb4369ee2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.831028 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvlst\" (UniqueName: \"kubernetes.io/projected/42062fcb-33f6-47fb-a7af-6a967ada6e86-kube-api-access-hvlst\") pod \"ovnkube-node-mhfxv\" (UID: \"42062fcb-33f6-47fb-a7af-6a967ada6e86\") " pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.832443 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtqhl\" (UniqueName: \"kubernetes.io/projected/5bfdae79-1660-45da-bd6e-1eb9d9553e51-kube-api-access-jtqhl\") pod \"node-ca-qpk58\" (UID: \"5bfdae79-1660-45da-bd6e-1eb9d9553e51\") " pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.833743 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqvtt\" (UniqueName: \"kubernetes.io/projected/34d3de0a-cfe4-4734-a8e1-679c97b90510-kube-api-access-lqvtt\") pod \"aws-ebs-csi-driver-node-r6ntt\" (UID: \"34d3de0a-cfe4-4734-a8e1-679c97b90510\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.835457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qjx\" (UniqueName: \"kubernetes.io/projected/2dc6a353-8356-4f38-bce0-bad1793051e4-kube-api-access-92qjx\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.835790 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f8z\" (UniqueName: \"kubernetes.io/projected/b46beeee-2a96-4b26-81ce-469ff50b810c-kube-api-access-58f8z\") pod \"iptables-alerter-5867w\" (UID: \"b46beeee-2a96-4b26-81ce-469ff50b810c\") " pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.835866 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76zm\" (UniqueName: \"kubernetes.io/projected/16032533-6dfb-4784-b7e5-ae615d9f64a0-kube-api-access-w76zm\") pod \"node-resolver-rrngf\" (UID: \"16032533-6dfb-4784-b7e5-ae615d9f64a0\") " pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.837105 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.837022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9566z\" (UniqueName: \"kubernetes.io/projected/354bf0ef-82fe-4d92-90b0-6b520909ada7-kube-api-access-9566z\") pod \"multus-additional-cni-plugins-c4bzz\" (UID: \"354bf0ef-82fe-4d92-90b0-6b520909ada7\") " pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:50.844392 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.844340 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" event={"ID":"aecee05319c003e574ec53a14a8ebc17","Type":"ContainerStarted","Data":"d7007086c8e1e500a3f4b30a8463a761e9008e38e793e0f63e25357f9616a561"} Jul 06 19:25:50.847174 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.847118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" event={"ID":"b47fecc3bc6b998318376f0c89d44556","Type":"ContainerStarted","Data":"cbb99054fb50b3ca928612c1c28ec7be6780cce015079545439c4a67bcc7c475"} Jul 06 19:25:50.848843 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.848816 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rrngf" Jul 06 19:25:50.889547 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.889513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" Jul 06 19:25:50.900934 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:50.900752 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrrff" Jul 06 19:25:50.906764 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:50.906728 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce80c087_4543_45f0_8ad7_fba963fd9023.slice/crio-51b53b6e7b6080bf4a9854209a0f96cedf4f848d44de5b138e26f3027faa38c6 WatchSource:0}: Error finding container 51b53b6e7b6080bf4a9854209a0f96cedf4f848d44de5b138e26f3027faa38c6: Status 404 returned error can't find the container with id 51b53b6e7b6080bf4a9854209a0f96cedf4f848d44de5b138e26f3027faa38c6 Jul 06 19:25:50.912338 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:50.912298 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc2201e_7673_4cfe_a44b_cc2c7d764eae.slice/crio-650469cc6b53001830cfbc95c142fe89ee93d4e8e2cc42a1174c7b0987f970a1 WatchSource:0}: Error finding container 650469cc6b53001830cfbc95c142fe89ee93d4e8e2cc42a1174c7b0987f970a1: Status 404 returned error can't find the container with id 650469cc6b53001830cfbc95c142fe89ee93d4e8e2cc42a1174c7b0987f970a1 Jul 06 19:25:51.019310 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.019280 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:25:51.021409 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.021322 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" Jul 06 19:25:51.021409 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.021347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qpk58" Jul 06 19:25:51.021409 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.021368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" Jul 06 19:25:51.021409 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.021383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:25:51.030305 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:51.030279 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42062fcb_33f6_47fb_a7af_6a967ada6e86.slice/crio-dd7ba84d7b8e0146d8f530abee005b2df597b8284afa99a702aa24da1d672b3c WatchSource:0}: Error finding container dd7ba84d7b8e0146d8f530abee005b2df597b8284afa99a702aa24da1d672b3c: Status 404 returned error can't find the container with id dd7ba84d7b8e0146d8f530abee005b2df597b8284afa99a702aa24da1d672b3c Jul 06 19:25:51.034340 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:51.034313 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d3de0a_cfe4_4734_a8e1_679c97b90510.slice/crio-60afed2bf4c0b55cc8132189a4cb79e7503b4076e4a99343233fe650864c4744 WatchSource:0}: Error finding container 60afed2bf4c0b55cc8132189a4cb79e7503b4076e4a99343233fe650864c4744: Status 404 returned error can't find the container with id 60afed2bf4c0b55cc8132189a4cb79e7503b4076e4a99343233fe650864c4744 Jul 06 19:25:51.044572 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:51.044541 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99d4fe8_7e7b_446d_a097_e0c8a14f0f07.slice/crio-dfcef91ea35ca2496a35b97edbc5c6abee68e5000ba9c5d35a0837d2e56a6fed WatchSource:0}: Error finding container dfcef91ea35ca2496a35b97edbc5c6abee68e5000ba9c5d35a0837d2e56a6fed: Status 404 returned error can't find the container with id dfcef91ea35ca2496a35b97edbc5c6abee68e5000ba9c5d35a0837d2e56a6fed Jul 06 19:25:51.045208 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:51.045151 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354bf0ef_82fe_4d92_90b0_6b520909ada7.slice/crio-dda380f62b9af8b2dcceb856bd71b0e31fe4ef3f181bec95d68a766a25994287 WatchSource:0}: Error finding container dda380f62b9af8b2dcceb856bd71b0e31fe4ef3f181bec95d68a766a25994287: Status 404 returned error can't find the container with id dda380f62b9af8b2dcceb856bd71b0e31fe4ef3f181bec95d68a766a25994287 Jul 06 19:25:51.088698 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.088618 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:25:51.112725 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.112694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5867w" Jul 06 19:25:51.127379 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:25:51.127340 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46beeee_2a96_4b26_81ce_469ff50b810c.slice/crio-be50a0fae150adf85e38794f3e32cf271c910ba06dca224e9d86ee29d4cf22e0 WatchSource:0}: Error finding container be50a0fae150adf85e38794f3e32cf271c910ba06dca224e9d86ee29d4cf22e0: Status 404 returned error can't find the container with id be50a0fae150adf85e38794f3e32cf271c910ba06dca224e9d86ee29d4cf22e0 Jul 06 19:25:51.324022 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.323981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:51.324223 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.324036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:51.324223 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.324143 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:51.324223 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.324159 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:51.324405 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.324232 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret podName:eec73bb3-c96f-429a-9b5f-8a3bd35d6504 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:52.32421143 +0000 UTC m=+4.081380915 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret") pod "global-pull-secret-syncer-kp5tk" (UID: "eec73bb3-c96f-429a-9b5f-8a3bd35d6504") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:51.324405 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.324251 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:52.324242252 +0000 UTC m=+4.081411730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:51.425156 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.425075 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:51.425296 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.425243 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:51.425296 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.425264 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:51.425296 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.425273 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nmvv7 for pod openshift-network-diagnostics/network-check-target-9dfnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:51.425436 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:51.425332 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7 podName:1953c5c9-8192-4e9e-b5da-5b5eb4369ee2 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:52.425313508 +0000 UTC m=+4.182482991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmvv7" (UniqueName: "kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7") pod "network-check-target-9dfnc" (UID: "1953c5c9-8192-4e9e-b5da-5b5eb4369ee2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:51.632454 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.632356 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:51 +0000 UTC" deadline="2028-01-14 17:32:54.258614679 +0000 UTC" Jul 06 19:25:51.632454 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.632395 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13366h7m2.626225474s" Jul 06 19:25:51.850282 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.850162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qpk58" event={"ID":"5bfdae79-1660-45da-bd6e-1eb9d9553e51","Type":"ContainerStarted","Data":"31fa299aa564913f016788865198e0b6b033b2013b707da9b39e41208d004054"} Jul 06 19:25:51.852882 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.852852 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"dd7ba84d7b8e0146d8f530abee005b2df597b8284afa99a702aa24da1d672b3c"} Jul 06 19:25:51.854610 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.854530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rrngf" event={"ID":"16032533-6dfb-4784-b7e5-ae615d9f64a0","Type":"ContainerStarted","Data":"5ba12a657d33561c72f47c71ead3f7b0f3c35f6fe896d216f10e7558a1b5e243"} Jul 06 19:25:51.855911 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.855880 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5867w" event={"ID":"b46beeee-2a96-4b26-81ce-469ff50b810c","Type":"ContainerStarted","Data":"be50a0fae150adf85e38794f3e32cf271c910ba06dca224e9d86ee29d4cf22e0"} Jul 06 19:25:51.860948 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.860277 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerStarted","Data":"dda380f62b9af8b2dcceb856bd71b0e31fe4ef3f181bec95d68a766a25994287"} Jul 06 19:25:51.863015 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.862936 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b22w2" event={"ID":"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07","Type":"ContainerStarted","Data":"dfcef91ea35ca2496a35b97edbc5c6abee68e5000ba9c5d35a0837d2e56a6fed"} Jul 06 19:25:51.865335 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.865228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" event={"ID":"34d3de0a-cfe4-4734-a8e1-679c97b90510","Type":"ContainerStarted","Data":"60afed2bf4c0b55cc8132189a4cb79e7503b4076e4a99343233fe650864c4744"} Jul 06 19:25:51.868618 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.868542 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrrff" event={"ID":"1dc2201e-7673-4cfe-a44b-cc2c7d764eae","Type":"ContainerStarted","Data":"650469cc6b53001830cfbc95c142fe89ee93d4e8e2cc42a1174c7b0987f970a1"} Jul 06 19:25:51.870493 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:51.870423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" event={"ID":"ce80c087-4543-45f0-8ad7-fba963fd9023","Type":"ContainerStarted","Data":"51b53b6e7b6080bf4a9854209a0f96cedf4f848d44de5b138e26f3027faa38c6"} Jul 06 19:25:52.332666 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.331884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:52.332666 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.331942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:52.332666 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.332072 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:52.332666 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.332145 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:54.332124289 +0000 UTC m=+6.089293776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:52.332666 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.332230 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:52.332666 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.332266 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret podName:eec73bb3-c96f-429a-9b5f-8a3bd35d6504 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:54.33225407 +0000 UTC m=+6.089423542 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret") pod "global-pull-secret-syncer-kp5tk" (UID: "eec73bb3-c96f-429a-9b5f-8a3bd35d6504") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:52.433192 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.432568 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:52.433192 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.432766 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:52.433192 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.432785 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:52.433192 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.432799 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nmvv7 for pod openshift-network-diagnostics/network-check-target-9dfnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:52.433192 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.432858 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7 podName:1953c5c9-8192-4e9e-b5da-5b5eb4369ee2 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:54.432840705 +0000 UTC m=+6.190010185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmvv7" (UniqueName: "kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7") pod "network-check-target-9dfnc" (UID: "1953c5c9-8192-4e9e-b5da-5b5eb4369ee2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:52.632945 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.632851 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:20:51 +0000 UTC" deadline="2027-12-17 00:27:53.063371109 +0000 UTC" Jul 06 19:25:52.632945 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.632898 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12677h2m0.430478258s" Jul 06 19:25:52.807175 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.806359 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:52.807175 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.806512 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:25:52.807175 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.806937 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:52.807175 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.807081 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:25:52.807838 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:52.807648 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:52.807838 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:52.807757 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:25:53.881419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:53.880808 2563 generic.go:356] "Generic (PLEG): container finished" podID="aecee05319c003e574ec53a14a8ebc17" containerID="b185e5d9ed4cbf55d17b9b74aee43d48f21e679dec8b3420fd0b73d00fcdce79" exitCode=0 Jul 06 19:25:53.881419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:53.881113 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" event={"ID":"aecee05319c003e574ec53a14a8ebc17","Type":"ContainerDied","Data":"b185e5d9ed4cbf55d17b9b74aee43d48f21e679dec8b3420fd0b73d00fcdce79"} Jul 06 19:25:53.888270 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:53.888241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" event={"ID":"b47fecc3bc6b998318376f0c89d44556","Type":"ContainerStarted","Data":"b9ebe836cae261b87be39edf5d2f02bdc95b1a6f576eafc6350cc03fb1bc163d"} Jul 06 19:25:53.957991 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:53.957934 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-35.ec2.internal" podStartSLOduration=3.957912276 podStartE2EDuration="3.957912276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:53.957260795 +0000 UTC m=+5.714430288" watchObservedRunningTime="2026-07-06 19:25:53.957912276 +0000 UTC m=+5.715081769" Jul 06 19:25:54.350320 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:54.350232 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:54.350320 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:54.350296 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:54.350545 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.350426 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:54.350545 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.350491 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:58.350470101 +0000 UTC m=+10.107639595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:54.350931 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.350899 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:54.351013 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.350957 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret podName:eec73bb3-c96f-429a-9b5f-8a3bd35d6504 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:58.350940776 +0000 UTC m=+10.108110263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret") pod "global-pull-secret-syncer-kp5tk" (UID: "eec73bb3-c96f-429a-9b5f-8a3bd35d6504") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:54.450964 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:54.450920 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:54.451149 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.451096 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:54.451149 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.451120 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:54.451149 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.451134 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nmvv7 for pod openshift-network-diagnostics/network-check-target-9dfnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:54.451344 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.451205 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7 podName:1953c5c9-8192-4e9e-b5da-5b5eb4369ee2 nodeName:}" failed. No retries permitted until 2026-07-06 19:25:58.451185836 +0000 UTC m=+10.208355324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmvv7" (UniqueName: "kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7") pod "network-check-target-9dfnc" (UID: "1953c5c9-8192-4e9e-b5da-5b5eb4369ee2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:54.808418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:54.808337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:54.808642 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.808492 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:25:54.808937 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:54.808893 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:54.809035 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.808999 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:25:54.809097 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:54.809064 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:54.809158 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:54.809139 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:25:56.805448 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:56.805413 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:56.805908 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:56.805555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:25:56.805993 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:56.805935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:56.806055 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:56.806038 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:25:56.806115 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:56.806082 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:56.806169 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:56.806136 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:25:58.386751 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:58.385882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:58.386751 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:58.385943 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:58.386751 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.386083 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:58.386751 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.386147 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:06.38612805 +0000 UTC m=+18.143297540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:25:58.386751 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.386612 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:58.386751 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.386668 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret podName:eec73bb3-c96f-429a-9b5f-8a3bd35d6504 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:06.386650586 +0000 UTC m=+18.143820061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret") pod "global-pull-secret-syncer-kp5tk" (UID: "eec73bb3-c96f-429a-9b5f-8a3bd35d6504") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:25:58.486724 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:58.486688 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:58.486895 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.486877 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:25:58.486895 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.486896 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:25:58.487009 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.486910 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nmvv7 for pod openshift-network-diagnostics/network-check-target-9dfnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:58.487009 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.486956 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7 podName:1953c5c9-8192-4e9e-b5da-5b5eb4369ee2 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:06.48694251 +0000 UTC m=+18.244111992 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmvv7" (UniqueName: "kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7") pod "network-check-target-9dfnc" (UID: "1953c5c9-8192-4e9e-b5da-5b5eb4369ee2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:25:58.806131 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:58.806057 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:25:58.806301 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:58.806182 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:25:58.806301 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:25:58.806230 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:25:58.806301 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.806247 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:25:58.806475 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.806315 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:25:58.806475 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:25:58.806397 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:00.805597 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:00.805317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:00.805597 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:00.805459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:00.805597 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:00.805454 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:00.805597 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:00.805556 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:00.806065 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:00.805599 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:00.806065 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:00.805713 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:02.805280 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:02.805247 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:02.805659 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:02.805370 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:02.805711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:02.805694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:02.805833 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:02.805797 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:02.805902 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:02.805832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:02.805956 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:02.805931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:04.805697 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:04.805664 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:04.805697 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:04.805699 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:04.806208 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:04.805664 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:04.806208 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:04.805783 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:04.806208 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:04.805883 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:04.806208 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:04.805962 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:06.447837 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:06.447799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:06.448280 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:06.447849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:06.448280 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.447972 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:26:06.448280 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.447978 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:26:06.448280 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.448039 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:22.448022029 +0000 UTC m=+34.205191501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:26:06.448280 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.448055 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret podName:eec73bb3-c96f-429a-9b5f-8a3bd35d6504 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:22.44804792 +0000 UTC m=+34.205217391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret") pod "global-pull-secret-syncer-kp5tk" (UID: "eec73bb3-c96f-429a-9b5f-8a3bd35d6504") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:26:06.548304 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:06.548273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:06.548468 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.548443 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:26:06.548468 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.548467 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:26:06.548543 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.548477 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nmvv7 for pod openshift-network-diagnostics/network-check-target-9dfnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:26:06.548543 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.548522 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7 podName:1953c5c9-8192-4e9e-b5da-5b5eb4369ee2 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:22.548509017 +0000 UTC m=+34.305678491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmvv7" (UniqueName: "kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7") pod "network-check-target-9dfnc" (UID: "1953c5c9-8192-4e9e-b5da-5b5eb4369ee2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:26:06.805807 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:06.805713 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:06.806000 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:06.805723 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:06.806000 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:06.805861 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:06.806000 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.805862 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:06.806000 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.805970 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:06.806202 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:06.806059 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:08.806186 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:08.806158 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:08.806696 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:08.806269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:08.806696 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:08.806294 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:08.806696 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:08.806267 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:08.806696 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:08.806345 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:08.806696 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:08.806392 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:10.805180 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.804879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:10.805891 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.804879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:10.805891 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:10.805258 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:10.805891 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.804886 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:10.805891 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:10.805343 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:10.805891 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:10.805437 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:10.922853 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.922788 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrrff" event={"ID":"1dc2201e-7673-4cfe-a44b-cc2c7d764eae","Type":"ContainerStarted","Data":"467a11d07b016e0f32c34b86bb139d497c1c75020050c267ee4da09ecf1118b9"} Jul 06 19:26:10.924297 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.924267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" event={"ID":"ce80c087-4543-45f0-8ad7-fba963fd9023","Type":"ContainerStarted","Data":"846b3ce3b4c4779c98579ada3c26d374564a36f11e4e3fb7e8d29e6b27124706"} Jul 06 19:26:10.926110 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.926088 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" event={"ID":"aecee05319c003e574ec53a14a8ebc17","Type":"ContainerStarted","Data":"d1779a3b7b813f6c3ce8f0a0c9fe011d9d587b9bf605a6a5aba44de9637ba46a"} Jul 06 19:26:10.927799 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.927778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qpk58" event={"ID":"5bfdae79-1660-45da-bd6e-1eb9d9553e51","Type":"ContainerStarted","Data":"fb3b52a66a9ce9e3499a7c88ef484d0786f3d06893c05f4cc47f925df83a6162"} Jul 06 19:26:10.930831 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.930802 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"a38fa6ddbdd962dc4418295ce38b8f2bd7fce7836eb580c39b04b45891c5ee92"} Jul 06 19:26:10.930943 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.930868 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"1f1f54be1e127e466d038d8ad8a8f3fbd95457b571c55c7b6a0bb8963313c360"} Jul 06 19:26:10.930943 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.930918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"91c41d009c23fb55513c8dd9e23ac0ff377bc2ad485dae6c804fae41f6bf8e97"} Jul 06 19:26:10.931057 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.930960 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"fc1b067b3993068bbde410fc9ff5a2e9a3f66eb2f37b26536a6647745c6ef782"} Jul 06 19:26:10.931057 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.931008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"e9ddffdf136ef8a9274cf003d84c31987ab158578cab63151c710d979f086368"} Jul 06 19:26:10.931140 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.931055 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"fb9f3e48b348db29085d4c6d1182984493e9f801e4163e281a15bbfd9a1d1c2d"} Jul 06 19:26:10.932385 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.932360 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rrngf" event={"ID":"16032533-6dfb-4784-b7e5-ae615d9f64a0","Type":"ContainerStarted","Data":"d3250c45fb9d7910950ac59e74c2b80dcbe485d250fd49e8fa662f4574b3c0df"} Jul 06 19:26:10.933920 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.933896 2563 generic.go:356] "Generic (PLEG): container finished" podID="354bf0ef-82fe-4d92-90b0-6b520909ada7" containerID="759374dae98bda69ec16c180877aa5a4d16493b4e17bc1f2813c1e16dc77d5f6" exitCode=0 Jul 06 19:26:10.934004 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.933939 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerDied","Data":"759374dae98bda69ec16c180877aa5a4d16493b4e17bc1f2813c1e16dc77d5f6"} Jul 06 19:26:10.935606 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.935580 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b22w2" event={"ID":"e99d4fe8-7e7b-446d-a097-e0c8a14f0f07","Type":"ContainerStarted","Data":"62b005666b2c641c38b582a8c74b442487bff0b4b78726dbf4ddcda843874a4b"} Jul 06 19:26:10.937189 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.937164 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" event={"ID":"34d3de0a-cfe4-4734-a8e1-679c97b90510","Type":"ContainerStarted","Data":"abe1a7ef401c77df39b84f5ceebb732408ef26c99f8f8f6b5681e70cfa35a78f"} Jul 06 19:26:10.946169 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.946077 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vrrff" podStartSLOduration=2.53978474 podStartE2EDuration="21.946061228s" totalImagesPullingTime="19.406276488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:10.94478557 +0000 UTC m=+22.701955042" watchObservedRunningTime="2026-07-06 19:26:10.946061228 +0000 UTC m=+22.703230717" Jul 06 19:26:10.961402 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:10.961360 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qpk58" podStartSLOduration=2.9766273180000002 podStartE2EDuration="21.961346295s" totalImagesPullingTime="18.984718977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:10.960816195 +0000 UTC m=+22.717985686" watchObservedRunningTime="2026-07-06 19:26:10.961346295 +0000 UTC m=+22.718515784" Jul 06 19:26:11.008356 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.008322 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rrngf" podStartSLOduration=7.3952283340000005 podStartE2EDuration="22.008309686s" totalImagesPullingTime="14.613081352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:11.007875485 +0000 UTC m=+22.765044974" watchObservedRunningTime="2026-07-06 19:26:11.008309686 +0000 UTC m=+22.765479174" Jul 06 19:26:11.032193 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.032161 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-35.ec2.internal" podStartSLOduration=21.032132095 podStartE2EDuration="21.032132095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:11.031864352 +0000 UTC m=+22.789033840" watchObservedRunningTime="2026-07-06 19:26:11.032132095 +0000 UTC m=+22.789301584" Jul 06 19:26:11.069348 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.069320 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6p4mv" podStartSLOduration=2.928467588 podStartE2EDuration="22.069312335s" totalImagesPullingTime="19.140844747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:11.069295646 +0000 UTC m=+22.826465135" watchObservedRunningTime="2026-07-06 19:26:11.069312335 +0000 UTC m=+22.826481824" Jul 06 19:26:11.646572 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.646546 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:26:11.661956 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.661852 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:26:11.646568745Z","UUID":"64162862-8f72-407d-ac07-f283aba828ed","Handler":null,"Name":"","Endpoint":""} Jul 06 19:26:11.663282 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.663265 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:26:11.663374 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.663307 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:26:11.940272 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.940201 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5867w" event={"ID":"b46beeee-2a96-4b26-81ce-469ff50b810c","Type":"ContainerStarted","Data":"148967d2847f13f8e93fc74b9d43946d0ccbf8300aca433705f8c8688c8cacce"} Jul 06 19:26:11.941967 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.941938 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" event={"ID":"34d3de0a-cfe4-4734-a8e1-679c97b90510","Type":"ContainerStarted","Data":"813f74293a988504401139a3542cb72a336b7cdaec3751fafd24ce397a993a51"} Jul 06 19:26:11.955720 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:11.955673 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b22w2" podStartSLOduration=3.952021717 podStartE2EDuration="22.955660643s" totalImagesPullingTime="19.003638926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:11.101557557 +0000 UTC m=+22.858727046" watchObservedRunningTime="2026-07-06 19:26:11.955660643 +0000 UTC m=+23.712830205" Jul 06 19:26:12.804782 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:12.804749 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:12.804913 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:12.804749 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:12.804913 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:12.804753 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:12.805635 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:12.805206 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:12.805635 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:12.805369 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:12.805635 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:12.805499 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:13.639937 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.639754 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:26:13.640370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.640251 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:26:13.656541 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.656506 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5867w" podStartSLOduration=10.265233211 podStartE2EDuration="24.656494441s" totalImagesPullingTime="14.39126123s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:11.955526983 +0000 UTC m=+23.712696471" watchObservedRunningTime="2026-07-06 19:26:13.656494441 +0000 UTC m=+25.413663929" Jul 06 19:26:13.950264 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.950180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"af85f9c34fba0e2f13ecc9cd0c8be3e526bafefaffc1e98110264a84f5f0e699"} Jul 06 19:26:13.952447 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.952389 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" event={"ID":"34d3de0a-cfe4-4734-a8e1-679c97b90510","Type":"ContainerStarted","Data":"b385b9c323d0d4308e81185e80754e2c628ec233b9e76dab3d8323d7e17aece4"} Jul 06 19:26:13.952809 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.952737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:26:13.953221 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.953204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b22w2" Jul 06 19:26:13.973080 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:13.973033 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6ntt" podStartSLOduration=3.572610444 podStartE2EDuration="24.973021294s" totalImagesPullingTime="21.40041085s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:13.972643814 +0000 UTC m=+25.729813302" watchObservedRunningTime="2026-07-06 19:26:13.973021294 +0000 UTC m=+25.730190783" Jul 06 19:26:14.805462 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:14.805433 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:14.805462 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:14.805455 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:14.806046 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:14.805495 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:14.806046 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:14.805604 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:14.806046 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:14.805661 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:14.806046 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:14.805721 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:16.808426 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.808405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:16.809056 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.808405 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:16.809056 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:16.808529 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:16.809056 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.808406 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:16.809056 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:16.808585 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:16.809056 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:16.808637 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:16.960613 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.960554 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" event={"ID":"42062fcb-33f6-47fb-a7af-6a967ada6e86","Type":"ContainerStarted","Data":"2307a2acab42cd9854346bc12d92e45110f4ec3a66ab1ace080de38fa2c7dcf4"} Jul 06 19:26:16.960802 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.960782 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:26:16.962367 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.962343 2563 generic.go:356] "Generic (PLEG): container finished" podID="354bf0ef-82fe-4d92-90b0-6b520909ada7" containerID="1fe0a59ec3f532c468978bc9792c0716fe04f66a45e0a4efb6f84ffba61746fc" exitCode=0 Jul 06 19:26:16.962443 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.962394 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerDied","Data":"1fe0a59ec3f532c468978bc9792c0716fe04f66a45e0a4efb6f84ffba61746fc"} Jul 06 19:26:16.975297 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:16.975276 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:26:17.035454 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:17.035416 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" podStartSLOduration=8.969599984 podStartE2EDuration="28.035399436s" totalImagesPullingTime="19.065799452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:17.029697547 +0000 UTC m=+28.786867049" watchObservedRunningTime="2026-07-06 19:26:17.035399436 +0000 UTC m=+28.792568924" Jul 06 19:26:17.965032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:17.964991 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:26:17.965599 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:17.965064 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:26:17.981465 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:17.981435 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:26:18.650287 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.650102 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fg2cc"] Jul 06 19:26:18.650450 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.650361 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:18.650555 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:18.650498 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:18.650778 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.650750 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kp5tk"] Jul 06 19:26:18.650865 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.650848 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:18.650969 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:18.650944 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:18.652344 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.652157 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dfnc"] Jul 06 19:26:18.652457 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.652396 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:18.652520 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:18.652496 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:18.968438 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.968358 2563 generic.go:356] "Generic (PLEG): container finished" podID="354bf0ef-82fe-4d92-90b0-6b520909ada7" containerID="647533d2c75e4e7e0d686462012c51f0d9eadf4065df4dbffce52c6dbc8a4008" exitCode=0 Jul 06 19:26:18.968823 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:18.968447 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerDied","Data":"647533d2c75e4e7e0d686462012c51f0d9eadf4065df4dbffce52c6dbc8a4008"} Jul 06 19:26:19.804954 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:19.804886 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:19.805090 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:19.804890 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:19.805090 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:19.804990 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:19.805090 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:19.805060 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:19.973343 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:19.973314 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerStarted","Data":"7e704b2cc4a83faee44e67213c1a7a7bd5989fd00b279e3efd70b37e74a7abc7"} Jul 06 19:26:20.808374 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:20.808308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:20.808516 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:20.808399 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:20.977842 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:20.977803 2563 generic.go:356] "Generic (PLEG): container finished" podID="354bf0ef-82fe-4d92-90b0-6b520909ada7" containerID="7e704b2cc4a83faee44e67213c1a7a7bd5989fd00b279e3efd70b37e74a7abc7" exitCode=0 Jul 06 19:26:20.978234 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:20.977877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerDied","Data":"7e704b2cc4a83faee44e67213c1a7a7bd5989fd00b279e3efd70b37e74a7abc7"} Jul 06 19:26:21.805437 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:21.805408 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:21.805626 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:21.805408 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:21.805626 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:21.805543 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5tk" podUID="eec73bb3-c96f-429a-9b5f-8a3bd35d6504" Jul 06 19:26:21.805732 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:21.805646 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fg2cc" podUID="2dc6a353-8356-4f38-bce0-bad1793051e4" Jul 06 19:26:22.465369 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:22.465336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:22.465369 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:22.465373 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:22.465818 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.465461 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:26:22.465818 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.465505 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:26:22.465818 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.465521 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:54.465503165 +0000 UTC m=+66.222672635 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:26:22.465818 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.465571 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret podName:eec73bb3-c96f-429a-9b5f-8a3bd35d6504 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:54.465552714 +0000 UTC m=+66.222722195 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret") pod "global-pull-secret-syncer-kp5tk" (UID: "eec73bb3-c96f-429a-9b5f-8a3bd35d6504") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:26:22.566040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:22.566007 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:22.566226 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.566208 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:26:22.566280 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.566236 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:26:22.566280 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.566250 2563 projected.go:196] Error preparing data for projected volume kube-api-access-nmvv7 for pod openshift-network-diagnostics/network-check-target-9dfnc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:26:22.566349 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.566311 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7 podName:1953c5c9-8192-4e9e-b5da-5b5eb4369ee2 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:54.566292934 +0000 UTC m=+66.323462416 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmvv7" (UniqueName: "kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7") pod "network-check-target-9dfnc" (UID: "1953c5c9-8192-4e9e-b5da-5b5eb4369ee2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:26:22.808506 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:22.808479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:22.808642 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:22.808584 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9dfnc" podUID="1953c5c9-8192-4e9e-b5da-5b5eb4369ee2" Jul 06 19:26:23.058400 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.058328 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-35.ec2.internal" event="NodeReady" Jul 06 19:26:23.058541 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.058472 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:26:23.121049 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.121018 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l94z7"] Jul 06 19:26:23.123161 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.123125 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.124752 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.124731 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vqkrz"] Jul 06 19:26:23.126814 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.126793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.127756 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.127734 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:26:23.127982 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.127878 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:26:23.128044 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.127878 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjqsb\"" Jul 06 19:26:23.128618 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.128599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:26:23.128958 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.128938 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:26:23.129055 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.128980 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:26:23.129055 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.128947 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sttlx\"" Jul 06 19:26:23.141921 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.141895 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l94z7"] Jul 06 19:26:23.145053 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.145031 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqkrz"] Jul 06 19:26:23.171165 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.171119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhb4\" (UniqueName: \"kubernetes.io/projected/5c233f07-695a-4fb6-a84f-cf7a0bad9152-kube-api-access-9qhb4\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.171313 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.171195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c233f07-695a-4fb6-a84f-cf7a0bad9152-config-volume\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.171313 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.171220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.171313 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.171248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sv2h\" (UniqueName: \"kubernetes.io/projected/51af992f-db03-4ae9-8760-e1954a587473-kube-api-access-6sv2h\") pod \"ingress-canary-vqkrz\" (UID: \"51af992f-db03-4ae9-8760-e1954a587473\") " pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.171464 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.171360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c233f07-695a-4fb6-a84f-cf7a0bad9152-tmp-dir\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.171464 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.171436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51af992f-db03-4ae9-8760-e1954a587473-cert\") pod \"ingress-canary-vqkrz\" (UID: \"51af992f-db03-4ae9-8760-e1954a587473\") " pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.272189 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272139 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c233f07-695a-4fb6-a84f-cf7a0bad9152-tmp-dir\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.272341 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272198 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51af992f-db03-4ae9-8760-e1954a587473-cert\") pod \"ingress-canary-vqkrz\" (UID: \"51af992f-db03-4ae9-8760-e1954a587473\") " pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.272341 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272221 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhb4\" (UniqueName: \"kubernetes.io/projected/5c233f07-695a-4fb6-a84f-cf7a0bad9152-kube-api-access-9qhb4\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.272341 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272251 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c233f07-695a-4fb6-a84f-cf7a0bad9152-config-volume\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.272341 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.272341 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sv2h\" (UniqueName: \"kubernetes.io/projected/51af992f-db03-4ae9-8760-e1954a587473-kube-api-access-6sv2h\") pod \"ingress-canary-vqkrz\" (UID: \"51af992f-db03-4ae9-8760-e1954a587473\") " pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.272583 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:23.272381 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:26:23.272583 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:23.272446 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:23.772428469 +0000 UTC m=+35.529597955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:26:23.272583 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c233f07-695a-4fb6-a84f-cf7a0bad9152-tmp-dir\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.272752 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.272735 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c233f07-695a-4fb6-a84f-cf7a0bad9152-config-volume\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.276312 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.276283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51af992f-db03-4ae9-8760-e1954a587473-cert\") pod \"ingress-canary-vqkrz\" (UID: \"51af992f-db03-4ae9-8760-e1954a587473\") " pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.282047 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.282026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhb4\" (UniqueName: \"kubernetes.io/projected/5c233f07-695a-4fb6-a84f-cf7a0bad9152-kube-api-access-9qhb4\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.282404 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.282380 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sv2h\" (UniqueName: \"kubernetes.io/projected/51af992f-db03-4ae9-8760-e1954a587473-kube-api-access-6sv2h\") pod \"ingress-canary-vqkrz\" (UID: \"51af992f-db03-4ae9-8760-e1954a587473\") " pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.441872 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.441826 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqkrz" Jul 06 19:26:23.775106 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.775026 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:23.775715 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:23.775141 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:26:23.775715 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:23.775213 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:24.775194177 +0000 UTC m=+36.532363652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:26:23.804952 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.804921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:23.805122 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.804921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:23.807625 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.807606 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmvz5\"" Jul 06 19:26:23.808213 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.808195 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:26:23.808213 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:23.808205 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:26:24.783130 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.783079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:24.783523 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:24.783225 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:26:24.783523 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:24.783270 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:26.783257638 +0000 UTC m=+38.540427109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:26:24.810077 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.810050 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:24.813700 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.813678 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:26:24.813878 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.813857 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x44r2\"" Jul 06 19:26:24.813977 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.813956 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:26:24.862812 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.862782 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqkrz"] Jul 06 19:26:24.868427 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:26:24.868399 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51af992f_db03_4ae9_8760_e1954a587473.slice/crio-1d6cd12ad4fddfb7878e6f210048e87c21f2b6ce8df38ede9629ebf93cf14e65 WatchSource:0}: Error finding container 1d6cd12ad4fddfb7878e6f210048e87c21f2b6ce8df38ede9629ebf93cf14e65: Status 404 returned error can't find the container with id 1d6cd12ad4fddfb7878e6f210048e87c21f2b6ce8df38ede9629ebf93cf14e65 Jul 06 19:26:24.989739 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.989642 2563 generic.go:356] "Generic (PLEG): container finished" podID="354bf0ef-82fe-4d92-90b0-6b520909ada7" containerID="f1d7677a255b6df852f06a2909d11c529b859db077d7129edfd92186ebb3b6a4" exitCode=0 Jul 06 19:26:24.989739 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.989723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerDied","Data":"f1d7677a255b6df852f06a2909d11c529b859db077d7129edfd92186ebb3b6a4"} Jul 06 19:26:24.990797 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:24.990769 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqkrz" event={"ID":"51af992f-db03-4ae9-8760-e1954a587473","Type":"ContainerStarted","Data":"1d6cd12ad4fddfb7878e6f210048e87c21f2b6ce8df38ede9629ebf93cf14e65"} Jul 06 19:26:25.997052 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:25.997022 2563 generic.go:356] "Generic (PLEG): container finished" podID="354bf0ef-82fe-4d92-90b0-6b520909ada7" containerID="10d232b261b1af3b27b26d0ec45bb589d61c9f192103b24b575320faff12478e" exitCode=0 Jul 06 19:26:25.997543 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:25.997072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerDied","Data":"10d232b261b1af3b27b26d0ec45bb589d61c9f192103b24b575320faff12478e"} Jul 06 19:26:26.799060 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:26.799024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:26.799229 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:26.799195 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:26:26.799298 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:26.799269 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:30.799254477 +0000 UTC m=+42.556423967 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:26:27.002533 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:27.002503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" event={"ID":"354bf0ef-82fe-4d92-90b0-6b520909ada7","Type":"ContainerStarted","Data":"002d88438373360a376654321844f9cdda4daf0ba7ead78e81b7c4921e1666c2"} Jul 06 19:26:27.030373 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:27.030332 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-c4bzz" podStartSLOduration=7.56750301 podStartE2EDuration="38.030315943s" totalImagesPullingTime="30.462812933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:27.029465673 +0000 UTC m=+38.786635153" watchObservedRunningTime="2026-07-06 19:26:27.030315943 +0000 UTC m=+38.787485410" Jul 06 19:26:28.006221 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:28.006181 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqkrz" event={"ID":"51af992f-db03-4ae9-8760-e1954a587473","Type":"ContainerStarted","Data":"f90fb74b820f789e567391c3432ef519d657e133dfca64765e256145d8877fbf"} Jul 06 19:26:28.024178 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:28.024119 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vqkrz" podStartSLOduration=2.595815742 podStartE2EDuration="5.024105307s" totalImagesPullingTime="2.428289565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:28.023456064 +0000 UTC m=+39.780625552" watchObservedRunningTime="2026-07-06 19:26:28.024105307 +0000 UTC m=+39.781274795" Jul 06 19:26:30.823263 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:30.823234 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:30.823649 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:30.823407 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:26:30.823649 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:30.823483 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:38.823461088 +0000 UTC m=+50.580630571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:26:38.882542 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:38.882504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:38.882966 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:38.882610 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:26:38.882966 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:38.882656 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:26:54.882644514 +0000 UTC m=+66.639813984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:26:49.992439 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:49.992411 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mhfxv" Jul 06 19:26:54.490240 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.490202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:54.490240 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.490250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:26:54.493064 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.493042 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:26:54.493201 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.493185 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:26:54.500447 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:54.500432 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:26:54.500520 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:54.500510 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs podName:2dc6a353-8356-4f38-bce0-bad1793051e4 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:58.500490255 +0000 UTC m=+130.257659739 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs") pod "network-metrics-daemon-fg2cc" (UID: "2dc6a353-8356-4f38-bce0-bad1793051e4") : secret "metrics-daemon-secret" not found Jul 06 19:26:54.503961 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.503944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eec73bb3-c96f-429a-9b5f-8a3bd35d6504-original-pull-secret\") pod \"global-pull-secret-syncer-kp5tk\" (UID: \"eec73bb3-c96f-429a-9b5f-8a3bd35d6504\") " pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:54.590822 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.590771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:54.593031 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.593012 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:26:54.603974 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.603957 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:26:54.615007 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.614985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmvv7\" (UniqueName: \"kubernetes.io/projected/1953c5c9-8192-4e9e-b5da-5b5eb4369ee2-kube-api-access-nmvv7\") pod \"network-check-target-9dfnc\" (UID: \"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2\") " pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:54.717196 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.717137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5tk" Jul 06 19:26:54.824260 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.823755 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x44r2\"" Jul 06 19:26:54.831763 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.831745 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:26:54.853211 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.853187 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kp5tk"] Jul 06 19:26:54.857947 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:26:54.857901 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeec73bb3_c96f_429a_9b5f_8a3bd35d6504.slice/crio-e16946fa231ca71281da834166721c735328658147c3c9afc72c9e0445383fe6 WatchSource:0}: Error finding container e16946fa231ca71281da834166721c735328658147c3c9afc72c9e0445383fe6: Status 404 returned error can't find the container with id e16946fa231ca71281da834166721c735328658147c3c9afc72c9e0445383fe6 Jul 06 19:26:54.891992 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.891964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:26:54.892156 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:54.892101 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:26:54.892227 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:26:54.892199 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:26.8921767 +0000 UTC m=+98.649346171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:26:54.950494 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:54.950461 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9dfnc"] Jul 06 19:26:54.953834 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:26:54.953809 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1953c5c9_8192_4e9e_b5da_5b5eb4369ee2.slice/crio-501545b159a9ff038c9dafec04b5690c8715b6dbe5507e9a192693df8f47db10 WatchSource:0}: Error finding container 501545b159a9ff038c9dafec04b5690c8715b6dbe5507e9a192693df8f47db10: Status 404 returned error can't find the container with id 501545b159a9ff038c9dafec04b5690c8715b6dbe5507e9a192693df8f47db10 Jul 06 19:26:55.065787 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:55.065709 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dfnc" event={"ID":"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2","Type":"ContainerStarted","Data":"501545b159a9ff038c9dafec04b5690c8715b6dbe5507e9a192693df8f47db10"} Jul 06 19:26:55.066804 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:26:55.066772 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kp5tk" event={"ID":"eec73bb3-c96f-429a-9b5f-8a3bd35d6504","Type":"ContainerStarted","Data":"e16946fa231ca71281da834166721c735328658147c3c9afc72c9e0445383fe6"} Jul 06 19:27:00.081926 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:00.081888 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9dfnc" event={"ID":"1953c5c9-8192-4e9e-b5da-5b5eb4369ee2","Type":"ContainerStarted","Data":"e94904b5748b9a2ed5cd360454ca8b8a5b40a209740b1f72b46cd7f3bf9094f9"} Jul 06 19:27:00.082353 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:00.082022 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:27:00.083238 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:00.083215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kp5tk" event={"ID":"eec73bb3-c96f-429a-9b5f-8a3bd35d6504","Type":"ContainerStarted","Data":"1d80b0e4a8555335a13e7906b99edea4e21dc15cbbe3ea7d49a1a5882f1bfead"} Jul 06 19:27:00.098554 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:00.098511 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9dfnc" podStartSLOduration=66.764564474 podStartE2EDuration="1m11.098497525s" totalImagesPullingTime="4.333933051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:00.097334632 +0000 UTC m=+71.854504148" watchObservedRunningTime="2026-07-06 19:27:00.098497525 +0000 UTC m=+71.855666992" Jul 06 19:27:00.115197 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:00.115109 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kp5tk" podStartSLOduration=66.681804448 podStartE2EDuration="1m11.115099037s" totalImagesPullingTime="4.433294589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:00.114597209 +0000 UTC m=+71.871766697" watchObservedRunningTime="2026-07-06 19:27:00.115099037 +0000 UTC m=+71.872268527" Jul 06 19:27:26.912771 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:26.912719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:27:26.913290 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:26.912839 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:27:26.913290 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:26.912903 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls podName:5c233f07-695a-4fb6-a84f-cf7a0bad9152 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:30.91289163 +0000 UTC m=+162.670061101 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls") pod "dns-default-l94z7" (UID: "5c233f07-695a-4fb6-a84f-cf7a0bad9152") : secret "dns-default-metrics-tls" not found Jul 06 19:27:31.088523 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:31.088492 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9dfnc" Jul 06 19:27:38.815578 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.815548 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2kcft"] Jul 06 19:27:38.818493 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.818478 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.820697 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.820677 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 19:27:38.821097 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.821081 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 19:27:38.821396 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.821379 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:27:38.821493 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.821399 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:27:38.822181 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.822162 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-npfr2\"" Jul 06 19:27:38.825940 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.825922 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 19:27:38.832521 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.832502 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2kcft"] Jul 06 19:27:38.890065 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.890039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4704e030-ed0e-4863-9571-371255f1568a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.890229 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.890074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4704e030-ed0e-4863-9571-371255f1568a-serving-cert\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.890229 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.890117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4704e030-ed0e-4863-9571-371255f1568a-tmp\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.890229 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.890134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5kc8\" (UniqueName: \"kubernetes.io/projected/4704e030-ed0e-4863-9571-371255f1568a-kube-api-access-d5kc8\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.890229 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.890166 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4704e030-ed0e-4863-9571-371255f1568a-snapshots\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.890229 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.890185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4704e030-ed0e-4863-9571-371255f1568a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.919524 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.919486 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-b4ccd844f-dqkq6"] Jul 06 19:27:38.921345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.921331 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:38.923655 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.923638 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:27:38.924077 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.924055 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dgmg2\"" Jul 06 19:27:38.924340 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.924320 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 19:27:38.924530 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.924515 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 19:27:38.924721 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.924705 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 19:27:38.924910 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.924896 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:27:38.925181 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.925168 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 19:27:38.936352 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.936331 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b4ccd844f-dqkq6"] Jul 06 19:27:38.991459 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4704e030-ed0e-4863-9571-371255f1568a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.991580 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4704e030-ed0e-4863-9571-371255f1568a-serving-cert\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.991580 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991491 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:38.991580 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991557 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-default-certificate\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:38.991730 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991594 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:38.991730 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrmzp\" (UniqueName: \"kubernetes.io/projected/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-kube-api-access-hrmzp\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:38.991730 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4704e030-ed0e-4863-9571-371255f1568a-tmp\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.991859 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991734 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5kc8\" (UniqueName: \"kubernetes.io/projected/4704e030-ed0e-4863-9571-371255f1568a-kube-api-access-d5kc8\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.991859 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4704e030-ed0e-4863-9571-371255f1568a-snapshots\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.991859 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-stats-auth\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:38.991859 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.991811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4704e030-ed0e-4863-9571-371255f1568a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.992104 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.992085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4704e030-ed0e-4863-9571-371255f1568a-tmp\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.992339 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.992323 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4704e030-ed0e-4863-9571-371255f1568a-snapshots\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.992409 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.992391 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4704e030-ed0e-4863-9571-371255f1568a-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.992696 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.992680 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4704e030-ed0e-4863-9571-371255f1568a-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:38.993877 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:38.993859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4704e030-ed0e-4863-9571-371255f1568a-serving-cert\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:39.002296 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.002271 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5kc8\" (UniqueName: \"kubernetes.io/projected/4704e030-ed0e-4863-9571-371255f1568a-kube-api-access-d5kc8\") pod \"insights-operator-5c847dcfc4-2kcft\" (UID: \"4704e030-ed0e-4863-9571-371255f1568a\") " pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:39.019672 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.019644 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v"] Jul 06 19:27:39.021464 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.021448 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.022912 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.022888 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4"] Jul 06 19:27:39.025216 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.025193 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 19:27:39.025655 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.025417 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:27:39.025655 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.025592 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 19:27:39.025792 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.025655 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bmvvc\"" Jul 06 19:27:39.026353 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.026053 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 19:27:39.027652 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.026700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:39.029110 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.029093 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:27:39.029110 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.029101 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:27:39.029259 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.029100 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w8tft\"" Jul 06 19:27:39.029387 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.029373 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:27:39.036764 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.036747 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v"] Jul 06 19:27:39.041854 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.041832 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4"] Jul 06 19:27:39.092368 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-stats-auth\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.092368 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092330 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7n2r\" (UniqueName: \"kubernetes.io/projected/2ad598f2-dbba-4b4e-9bcb-398593206010-kube-api-access-b7n2r\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-default-certificate\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092421 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ad598f2-dbba-4b4e-9bcb-398593206010-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092480 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ad598f2-dbba-4b4e-9bcb-398593206010-config\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.092511 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrmzp\" (UniqueName: \"kubernetes.io/projected/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-kube-api-access-hrmzp\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.092527 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:27:39.092576 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.092569 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:39.592546694 +0000 UTC m=+111.349716161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : configmap references non-existent config key: service-ca.crt Jul 06 19:27:39.092886 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.092598 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:39.592582706 +0000 UTC m=+111.349752187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : secret "router-metrics-certs-default" not found Jul 06 19:27:39.094736 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.094711 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-default-certificate\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.094826 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.094741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-stats-auth\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.103273 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.103253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrmzp\" (UniqueName: \"kubernetes.io/projected/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-kube-api-access-hrmzp\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.125053 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.125032 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8"] Jul 06 19:27:39.127053 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.127039 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" Jul 06 19:27:39.127333 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.127316 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" Jul 06 19:27:39.132252 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.131860 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 19:27:39.132252 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.132136 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:27:39.132252 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.132219 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-jzjcx\"" Jul 06 19:27:39.148384 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.148356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8"] Jul 06 19:27:39.193240 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.193092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ad598f2-dbba-4b4e-9bcb-398593206010-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.193383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.193261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:39.193383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.193306 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmgws\" (UniqueName: \"kubernetes.io/projected/377bc1a4-df1c-4135-b591-fbc4e6d951ad-kube-api-access-dmgws\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:39.193383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.193331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ad598f2-dbba-4b4e-9bcb-398593206010-config\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.193545 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.193452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7n2r\" (UniqueName: \"kubernetes.io/projected/2ad598f2-dbba-4b4e-9bcb-398593206010-kube-api-access-b7n2r\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.193825 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.193809 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ad598f2-dbba-4b4e-9bcb-398593206010-config\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.195362 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.195347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ad598f2-dbba-4b4e-9bcb-398593206010-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.207366 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.207346 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7n2r\" (UniqueName: \"kubernetes.io/projected/2ad598f2-dbba-4b4e-9bcb-398593206010-kube-api-access-b7n2r\") pod \"service-ca-operator-5d46d9ffd4-qws9v\" (UID: \"2ad598f2-dbba-4b4e-9bcb-398593206010\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.255227 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.255200 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-2kcft"] Jul 06 19:27:39.258709 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:27:39.258684 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4704e030_ed0e_4863_9571_371255f1568a.slice/crio-c0da690eb59fb5ba4aca2ca5e1a9995cae741c2a0676d62ce00830ee60c45533 WatchSource:0}: Error finding container c0da690eb59fb5ba4aca2ca5e1a9995cae741c2a0676d62ce00830ee60c45533: Status 404 returned error can't find the container with id c0da690eb59fb5ba4aca2ca5e1a9995cae741c2a0676d62ce00830ee60c45533 Jul 06 19:27:39.294359 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.294327 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:39.294469 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.294372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmgws\" (UniqueName: \"kubernetes.io/projected/377bc1a4-df1c-4135-b591-fbc4e6d951ad-kube-api-access-dmgws\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:39.294469 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.294406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvnnq\" (UniqueName: \"kubernetes.io/projected/f3e0ad74-8cd3-45bb-84bd-5f5295a34e92-kube-api-access-kvnnq\") pod \"volume-data-source-validator-5d456fdbcd-l6dd8\" (UID: \"f3e0ad74-8cd3-45bb-84bd-5f5295a34e92\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" Jul 06 19:27:39.294469 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.294456 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:27:39.294608 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.294511 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls podName:377bc1a4-df1c-4135-b591-fbc4e6d951ad nodeName:}" failed. No retries permitted until 2026-07-06 19:27:39.794492186 +0000 UTC m=+111.551661653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2c9c4" (UID: "377bc1a4-df1c-4135-b591-fbc4e6d951ad") : secret "samples-operator-tls" not found Jul 06 19:27:39.304954 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.304928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmgws\" (UniqueName: \"kubernetes.io/projected/377bc1a4-df1c-4135-b591-fbc4e6d951ad-kube-api-access-dmgws\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:39.332953 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.332935 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" Jul 06 19:27:39.390423 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.390396 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk"] Jul 06 19:27:39.392594 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.392574 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.394858 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.394834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvnnq\" (UniqueName: \"kubernetes.io/projected/f3e0ad74-8cd3-45bb-84bd-5f5295a34e92-kube-api-access-kvnnq\") pod \"volume-data-source-validator-5d456fdbcd-l6dd8\" (UID: \"f3e0ad74-8cd3-45bb-84bd-5f5295a34e92\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" Jul 06 19:27:39.403038 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.403015 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:27:39.403638 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.403332 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:27:39.403638 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.403335 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:27:39.417808 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.417619 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6n6rw\"" Jul 06 19:27:39.418707 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.418015 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:27:39.419227 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.419166 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk"] Jul 06 19:27:39.422132 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.422108 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvnnq\" (UniqueName: \"kubernetes.io/projected/f3e0ad74-8cd3-45bb-84bd-5f5295a34e92-kube-api-access-kvnnq\") pod \"volume-data-source-validator-5d456fdbcd-l6dd8\" (UID: \"f3e0ad74-8cd3-45bb-84bd-5f5295a34e92\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" Jul 06 19:27:39.437226 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.437206 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" Jul 06 19:27:39.468518 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.468486 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v"] Jul 06 19:27:39.472819 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:27:39.472796 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad598f2_dbba_4b4e_9bcb_398593206010.slice/crio-1c0841443e67f192c4f4839d9f52d0ada99c12e0f125b968cfeec91616a62879 WatchSource:0}: Error finding container 1c0841443e67f192c4f4839d9f52d0ada99c12e0f125b968cfeec91616a62879: Status 404 returned error can't find the container with id 1c0841443e67f192c4f4839d9f52d0ada99c12e0f125b968cfeec91616a62879 Jul 06 19:27:39.495575 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.495552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4102759-254e-40eb-bc79-dd9ab5b05cee-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.495684 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.495596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4102759-254e-40eb-bc79-dd9ab5b05cee-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.495730 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.495713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxjw2\" (UniqueName: \"kubernetes.io/projected/a4102759-254e-40eb-bc79-dd9ab5b05cee-kube-api-access-mxjw2\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.571464 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.571435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8"] Jul 06 19:27:39.574442 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:27:39.574412 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e0ad74_8cd3_45bb_84bd_5f5295a34e92.slice/crio-21b9a9017931490198348cfd6d9350644b7e7458db795b997cb42d5eb037a0df WatchSource:0}: Error finding container 21b9a9017931490198348cfd6d9350644b7e7458db795b997cb42d5eb037a0df: Status 404 returned error can't find the container with id 21b9a9017931490198348cfd6d9350644b7e7458db795b997cb42d5eb037a0df Jul 06 19:27:39.596644 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.596624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.596771 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.596667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:39.596828 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.596771 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:27:39.596828 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.596802 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:40.596782602 +0000 UTC m=+112.353952089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : configmap references non-existent config key: service-ca.crt Jul 06 19:27:39.596828 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.596824 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:40.596814861 +0000 UTC m=+112.353984342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : secret "router-metrics-certs-default" not found Jul 06 19:27:39.596984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.596842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxjw2\" (UniqueName: \"kubernetes.io/projected/a4102759-254e-40eb-bc79-dd9ab5b05cee-kube-api-access-mxjw2\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.596984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.596878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4102759-254e-40eb-bc79-dd9ab5b05cee-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.596984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.596919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4102759-254e-40eb-bc79-dd9ab5b05cee-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.597378 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.597361 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a4102759-254e-40eb-bc79-dd9ab5b05cee-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.598886 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.598866 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a4102759-254e-40eb-bc79-dd9ab5b05cee-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.611321 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.611295 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxjw2\" (UniqueName: \"kubernetes.io/projected/a4102759-254e-40eb-bc79-dd9ab5b05cee-kube-api-access-mxjw2\") pod \"kube-storage-version-migrator-operator-846bf668f7-kf9nk\" (UID: \"a4102759-254e-40eb-bc79-dd9ab5b05cee\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.701412 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.701357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" Jul 06 19:27:39.798663 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.798633 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:39.798794 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.798774 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:27:39.798845 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:39.798840 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls podName:377bc1a4-df1c-4135-b591-fbc4e6d951ad nodeName:}" failed. No retries permitted until 2026-07-06 19:27:40.79882646 +0000 UTC m=+112.555995932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2c9c4" (UID: "377bc1a4-df1c-4135-b591-fbc4e6d951ad") : secret "samples-operator-tls" not found Jul 06 19:27:39.817922 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:39.817808 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk"] Jul 06 19:27:40.182641 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:40.182601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" event={"ID":"f3e0ad74-8cd3-45bb-84bd-5f5295a34e92","Type":"ContainerStarted","Data":"21b9a9017931490198348cfd6d9350644b7e7458db795b997cb42d5eb037a0df"} Jul 06 19:27:40.184102 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:40.184072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" event={"ID":"2ad598f2-dbba-4b4e-9bcb-398593206010","Type":"ContainerStarted","Data":"1c0841443e67f192c4f4839d9f52d0ada99c12e0f125b968cfeec91616a62879"} Jul 06 19:27:40.185660 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:40.185634 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" event={"ID":"a4102759-254e-40eb-bc79-dd9ab5b05cee","Type":"ContainerStarted","Data":"3ba3ad3b6064f06e2f12e12c9cc84007479efddf67616e6d02374e4e468597f5"} Jul 06 19:27:40.187509 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:40.187482 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" event={"ID":"4704e030-ed0e-4863-9571-371255f1568a","Type":"ContainerStarted","Data":"c0da690eb59fb5ba4aca2ca5e1a9995cae741c2a0676d62ce00830ee60c45533"} Jul 06 19:27:40.606600 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:40.606374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:40.606600 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:40.606440 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:40.606600 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:40.606538 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:27:40.606850 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:40.606623 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:42.606603309 +0000 UTC m=+114.363772788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : secret "router-metrics-certs-default" not found Jul 06 19:27:40.606850 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:40.606642 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:42.606633121 +0000 UTC m=+114.363802601 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : configmap references non-existent config key: service-ca.crt Jul 06 19:27:40.808384 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:40.808349 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:40.809349 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:40.808505 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:27:40.809349 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:40.808597 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls podName:377bc1a4-df1c-4135-b591-fbc4e6d951ad nodeName:}" failed. No retries permitted until 2026-07-06 19:27:42.80857848 +0000 UTC m=+114.565747968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2c9c4" (UID: "377bc1a4-df1c-4135-b591-fbc4e6d951ad") : secret "samples-operator-tls" not found Jul 06 19:27:41.192797 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:41.192760 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" event={"ID":"f3e0ad74-8cd3-45bb-84bd-5f5295a34e92","Type":"ContainerStarted","Data":"73f372bbdafa067d3212541d5f4839fdd6f4458231f4b2a402695d618a4fd66d"} Jul 06 19:27:42.624518 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:42.624478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:42.625061 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:42.624543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:42.625061 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:42.624649 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:27:42.625061 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:42.624705 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:46.6246856 +0000 UTC m=+118.381855071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : configmap references non-existent config key: service-ca.crt Jul 06 19:27:42.625061 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:42.624747 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:46.62473859 +0000 UTC m=+118.381908060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : secret "router-metrics-certs-default" not found Jul 06 19:27:42.826762 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:42.826727 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:42.826951 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:42.826857 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:27:42.826951 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:42.826919 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls podName:377bc1a4-df1c-4135-b591-fbc4e6d951ad nodeName:}" failed. No retries permitted until 2026-07-06 19:27:46.826901769 +0000 UTC m=+118.584071249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2c9c4" (UID: "377bc1a4-df1c-4135-b591-fbc4e6d951ad") : secret "samples-operator-tls" not found Jul 06 19:27:43.201212 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.201171 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" event={"ID":"2ad598f2-dbba-4b4e-9bcb-398593206010","Type":"ContainerStarted","Data":"58bfbc6e645a384ac4a8689ee306876719c78a4011729ffa74d3ab52eb7558d3"} Jul 06 19:27:43.202634 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.202612 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" event={"ID":"a4102759-254e-40eb-bc79-dd9ab5b05cee","Type":"ContainerStarted","Data":"74555845ff8025468db4a10d536390e7835a70b565c9b1cdbb331d210ea223e0"} Jul 06 19:27:43.204005 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.203980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" event={"ID":"4704e030-ed0e-4863-9571-371255f1568a","Type":"ContainerStarted","Data":"b563a5f4bab17fc9834e73604fc19692410182c04dc4eecd737170b2c8748619"} Jul 06 19:27:43.218353 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.218298 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-l6dd8" podStartSLOduration=3.1145633090000002 podStartE2EDuration="4.218279393s" totalImagesPullingTime="1.103716084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:41.217292415 +0000 UTC m=+112.974461904" watchObservedRunningTime="2026-07-06 19:27:43.218279393 +0000 UTC m=+114.975448883" Jul 06 19:27:43.237090 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.237030 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" podStartSLOduration=1.361352001 podStartE2EDuration="4.237013439s" totalImagesPullingTime="2.875661438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:43.217452711 +0000 UTC m=+114.974622195" watchObservedRunningTime="2026-07-06 19:27:43.237013439 +0000 UTC m=+114.994182929" Jul 06 19:27:43.237240 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.237127 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" podStartSLOduration=1.708091675 podStartE2EDuration="4.237120484s" totalImagesPullingTime="2.529028809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:43.237078788 +0000 UTC m=+114.994248278" watchObservedRunningTime="2026-07-06 19:27:43.237120484 +0000 UTC m=+114.994289974" Jul 06 19:27:43.256491 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.256438 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" podStartSLOduration=2.174647679 podStartE2EDuration="5.256419398s" totalImagesPullingTime="3.081771719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:43.255753943 +0000 UTC m=+115.012923434" watchObservedRunningTime="2026-07-06 19:27:43.256419398 +0000 UTC m=+115.013588889" Jul 06 19:27:43.776130 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.776095 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-279sr"] Jul 06 19:27:43.778685 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.778662 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:43.781685 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.781658 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:27:43.781789 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.781704 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:27:43.782225 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.782016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtdxx\"" Jul 06 19:27:43.799591 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.796514 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-279sr"] Jul 06 19:27:43.937958 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.937928 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:43.938123 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.937979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:43.938123 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.938049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659nn\" (UniqueName: \"kubernetes.io/projected/11fac460-bb97-487e-8adf-35bcc2164b86-kube-api-access-659nn\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:43.938123 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.938098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11fac460-bb97-487e-8adf-35bcc2164b86-crio-socket\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:43.938255 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:43.938137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11fac460-bb97-487e-8adf-35bcc2164b86-data-volume\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.039270 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.039192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.039270 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.039252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.039270 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.039273 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-659nn\" (UniqueName: \"kubernetes.io/projected/11fac460-bb97-487e-8adf-35bcc2164b86-kube-api-access-659nn\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.039519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.039289 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11fac460-bb97-487e-8adf-35bcc2164b86-crio-socket\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.039519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.039321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11fac460-bb97-487e-8adf-35bcc2164b86-data-volume\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.039519 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.039345 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:27:44.039519 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.039429 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:44.539408522 +0000 UTC m=+116.296577992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : secret "insights-runtime-extractor-tls" not found Jul 06 19:27:44.039519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.039421 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11fac460-bb97-487e-8adf-35bcc2164b86-crio-socket\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.039519 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.039451 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:27:44.039519 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.039514 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:44.539496672 +0000 UTC m=+116.296666152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : configmap "kube-rbac-proxy" not found Jul 06 19:27:44.039745 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.039669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11fac460-bb97-487e-8adf-35bcc2164b86-data-volume\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.051360 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.051330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-659nn\" (UniqueName: \"kubernetes.io/projected/11fac460-bb97-487e-8adf-35bcc2164b86-kube-api-access-659nn\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.544692 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.544659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.544847 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:44.544735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:44.544847 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.544803 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:27:44.544928 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.544845 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:27:44.544928 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.544879 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:45.544862892 +0000 UTC m=+117.302032364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : secret "insights-runtime-extractor-tls" not found Jul 06 19:27:44.544928 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:44.544895 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:45.544887439 +0000 UTC m=+117.302056909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : configmap "kube-rbac-proxy" not found Jul 06 19:27:45.188446 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.188411 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644"] Jul 06 19:27:45.190891 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.190871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" Jul 06 19:27:45.193988 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.193962 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5wnt6\"" Jul 06 19:27:45.194581 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.194564 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 19:27:45.194679 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.194600 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 19:27:45.200245 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.200226 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644"] Jul 06 19:27:45.351403 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.351372 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6z6v\" (UniqueName: \"kubernetes.io/projected/543d32d5-5ae8-4bc2-99dc-d04f1e2389b0-kube-api-access-q6z6v\") pod \"migrator-d57d58cc9-v2644\" (UID: \"543d32d5-5ae8-4bc2-99dc-d04f1e2389b0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" Jul 06 19:27:45.452357 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.452276 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6z6v\" (UniqueName: \"kubernetes.io/projected/543d32d5-5ae8-4bc2-99dc-d04f1e2389b0-kube-api-access-q6z6v\") pod \"migrator-d57d58cc9-v2644\" (UID: \"543d32d5-5ae8-4bc2-99dc-d04f1e2389b0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" Jul 06 19:27:45.468420 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.468394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6z6v\" (UniqueName: \"kubernetes.io/projected/543d32d5-5ae8-4bc2-99dc-d04f1e2389b0-kube-api-access-q6z6v\") pod \"migrator-d57d58cc9-v2644\" (UID: \"543d32d5-5ae8-4bc2-99dc-d04f1e2389b0\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" Jul 06 19:27:45.500230 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.500203 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" Jul 06 19:27:45.553699 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.553654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:45.553903 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:45.553803 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:27:45.554565 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:45.554532 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:47.554504244 +0000 UTC m=+119.311673726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : secret "insights-runtime-extractor-tls" not found Jul 06 19:27:45.554774 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.554742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:45.555042 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:45.554927 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:27:45.555123 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:45.555093 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:47.555074682 +0000 UTC m=+119.312244152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : configmap "kube-rbac-proxy" not found Jul 06 19:27:45.626456 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.626434 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644"] Jul 06 19:27:45.627973 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:27:45.627943 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543d32d5_5ae8_4bc2_99dc_d04f1e2389b0.slice/crio-2f15174ee403f8954f6aa5443e45d6f853bb2682d865e25c034fa3bba2a67bac WatchSource:0}: Error finding container 2f15174ee403f8954f6aa5443e45d6f853bb2682d865e25c034fa3bba2a67bac: Status 404 returned error can't find the container with id 2f15174ee403f8954f6aa5443e45d6f853bb2682d865e25c034fa3bba2a67bac Jul 06 19:27:45.947030 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:45.947002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rrngf_16032533-6dfb-4784-b7e5-ae615d9f64a0/dns-node-resolver/0.log" Jul 06 19:27:46.169869 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.169839 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s4m96"] Jul 06 19:27:46.172462 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.172447 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.177225 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.177192 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 19:27:46.177225 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.177213 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 19:27:46.177400 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.177235 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-dl7t2\"" Jul 06 19:27:46.177874 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.177857 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 19:27:46.178418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.178401 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 19:27:46.183091 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.183073 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s4m96"] Jul 06 19:27:46.217659 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.217578 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" event={"ID":"543d32d5-5ae8-4bc2-99dc-d04f1e2389b0","Type":"ContainerStarted","Data":"2f15174ee403f8954f6aa5443e45d6f853bb2682d865e25c034fa3bba2a67bac"} Jul 06 19:27:46.360658 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.360617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/43e0e181-24e7-4f40-afcd-29f47649a23a-signing-key\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.360812 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.360766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/43e0e181-24e7-4f40-afcd-29f47649a23a-signing-cabundle\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.360812 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.360801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg94g\" (UniqueName: \"kubernetes.io/projected/43e0e181-24e7-4f40-afcd-29f47649a23a-kube-api-access-wg94g\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.461846 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.461807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/43e0e181-24e7-4f40-afcd-29f47649a23a-signing-cabundle\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.462029 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.461856 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg94g\" (UniqueName: \"kubernetes.io/projected/43e0e181-24e7-4f40-afcd-29f47649a23a-kube-api-access-wg94g\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.462029 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.461942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/43e0e181-24e7-4f40-afcd-29f47649a23a-signing-key\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.462582 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.462556 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/43e0e181-24e7-4f40-afcd-29f47649a23a-signing-cabundle\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.464499 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.464479 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/43e0e181-24e7-4f40-afcd-29f47649a23a-signing-key\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.471426 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.471378 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg94g\" (UniqueName: \"kubernetes.io/projected/43e0e181-24e7-4f40-afcd-29f47649a23a-kube-api-access-wg94g\") pod \"service-ca-758f599c5-s4m96\" (UID: \"43e0e181-24e7-4f40-afcd-29f47649a23a\") " pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.481254 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.481234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s4m96" Jul 06 19:27:46.546666 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.546644 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qpk58_5bfdae79-1660-45da-bd6e-1eb9d9553e51/node-ca/0.log" Jul 06 19:27:46.598942 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.598914 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s4m96"] Jul 06 19:27:46.602033 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:27:46.602009 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e0e181_24e7_4f40_afcd_29f47649a23a.slice/crio-30efde0ff7ae8d66eec93109a49fa4067e4e9d99049f6d7271e7559d8e64afea WatchSource:0}: Error finding container 30efde0ff7ae8d66eec93109a49fa4067e4e9d99049f6d7271e7559d8e64afea: Status 404 returned error can't find the container with id 30efde0ff7ae8d66eec93109a49fa4067e4e9d99049f6d7271e7559d8e64afea Jul 06 19:27:46.664125 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.664095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:46.664279 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.664200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:46.664279 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:46.664265 2563 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 19:27:46.664393 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:46.664344 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.664323274 +0000 UTC m=+126.421492745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : secret "router-metrics-certs-default" not found Jul 06 19:27:46.664393 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:46.664363 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.664353891 +0000 UTC m=+126.421523358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : configmap references non-existent config key: service-ca.crt Jul 06 19:27:46.866715 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:46.866621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:46.866846 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:46.866775 2563 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:27:46.866846 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:46.866839 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls podName:377bc1a4-df1c-4135-b591-fbc4e6d951ad nodeName:}" failed. No retries permitted until 2026-07-06 19:27:54.866823469 +0000 UTC m=+126.623992941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2c9c4" (UID: "377bc1a4-df1c-4135-b591-fbc4e6d951ad") : secret "samples-operator-tls" not found Jul 06 19:27:47.225165 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:47.225082 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s4m96" event={"ID":"43e0e181-24e7-4f40-afcd-29f47649a23a","Type":"ContainerStarted","Data":"74fb7fe9771943b312d881f190d78bdd519a48d42eb4250fe65e4eb71082c8af"} Jul 06 19:27:47.225165 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:47.225167 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s4m96" event={"ID":"43e0e181-24e7-4f40-afcd-29f47649a23a","Type":"ContainerStarted","Data":"30efde0ff7ae8d66eec93109a49fa4067e4e9d99049f6d7271e7559d8e64afea"} Jul 06 19:27:47.571836 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:47.571746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:47.571836 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:47.571802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:47.572041 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:47.571868 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:27:47.572041 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:47.571907 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:27:47.572041 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:47.571917 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.571904111 +0000 UTC m=+123.329073582 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : configmap "kube-rbac-proxy" not found Jul 06 19:27:47.572041 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:47.571977 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:51.571961331 +0000 UTC m=+123.329130808 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : secret "insights-runtime-extractor-tls" not found Jul 06 19:27:47.745555 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:47.745528 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vqkrz_51af992f-db03-4ae9-8760-e1954a587473/serve-healthcheck-canary/0.log" Jul 06 19:27:48.229455 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:48.229417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" event={"ID":"543d32d5-5ae8-4bc2-99dc-d04f1e2389b0","Type":"ContainerStarted","Data":"8fcb3114c0bd535209da11d62c59722f123b7b9d9a777f0ed36cc40c48f75c2a"} Jul 06 19:27:48.229885 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:48.229475 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" event={"ID":"543d32d5-5ae8-4bc2-99dc-d04f1e2389b0","Type":"ContainerStarted","Data":"66595350626d01e404ca2065667b7fee2f3721952f76cbf7684c414c748838cd"} Jul 06 19:27:48.248801 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:48.248736 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-v2644" podStartSLOduration=1.596652385 podStartE2EDuration="3.248715383s" totalImagesPullingTime="1.652062998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:48.247300706 +0000 UTC m=+120.004470194" watchObservedRunningTime="2026-07-06 19:27:48.248715383 +0000 UTC m=+120.005884876" Jul 06 19:27:48.248983 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:48.248845 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-s4m96" podStartSLOduration=2.248835374 podStartE2EDuration="2.248835374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:47.265516884 +0000 UTC m=+119.022686375" watchObservedRunningTime="2026-07-06 19:27:48.248835374 +0000 UTC m=+120.006004864" Jul 06 19:27:51.605454 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:51.605420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:51.605871 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:51.605477 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:51.605871 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:51.605566 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:27:51.605871 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:51.605594 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:27:51.605871 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:51.605611 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.605599093 +0000 UTC m=+131.362768564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : configmap "kube-rbac-proxy" not found Jul 06 19:27:51.605871 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:51.605656 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls podName:11fac460-bb97-487e-8adf-35bcc2164b86 nodeName:}" failed. No retries permitted until 2026-07-06 19:27:59.605638574 +0000 UTC m=+131.362808057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls") pod "insights-runtime-extractor-279sr" (UID: "11fac460-bb97-487e-8adf-35bcc2164b86") : secret "insights-runtime-extractor-tls" not found Jul 06 19:27:54.730219 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:54.730184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:54.730578 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:54.730278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:54.730578 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:27:54.730332 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle podName:1b86f430-aedd-43ae-a4fa-9bc4de23dc8b nodeName:}" failed. No retries permitted until 2026-07-06 19:28:10.73031495 +0000 UTC m=+142.487484420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle") pod "router-default-b4ccd844f-dqkq6" (UID: "1b86f430-aedd-43ae-a4fa-9bc4de23dc8b") : configmap references non-existent config key: service-ca.crt Jul 06 19:27:54.732589 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:54.732573 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-metrics-certs\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:27:54.931553 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:54.931526 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:54.933944 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:54.933922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/377bc1a4-df1c-4135-b591-fbc4e6d951ad-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2c9c4\" (UID: \"377bc1a4-df1c-4135-b591-fbc4e6d951ad\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:54.942103 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:54.942075 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w8tft\"" Jul 06 19:27:54.947812 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:54.947791 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" Jul 06 19:27:55.070558 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:55.070530 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4"] Jul 06 19:27:55.250230 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:55.250162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" event={"ID":"377bc1a4-df1c-4135-b591-fbc4e6d951ad","Type":"ContainerStarted","Data":"31aca2bd4cc5c837b3c837e7dc2f27d04277c3872c75b132eb84fba18a0b7e0a"} Jul 06 19:27:57.257724 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:57.257681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" event={"ID":"377bc1a4-df1c-4135-b591-fbc4e6d951ad","Type":"ContainerStarted","Data":"f707c5e485a1300df078d0929760980b46ae6e3b497fc69f96444afce952148e"} Jul 06 19:27:57.258109 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:57.257739 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" event={"ID":"377bc1a4-df1c-4135-b591-fbc4e6d951ad","Type":"ContainerStarted","Data":"5d7e592a96cffa8d7b249ffc8758177bb3335d5446c2a553927dd157bea3607a"} Jul 06 19:27:57.277327 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:57.277218 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2c9c4" podStartSLOduration=16.37460376 podStartE2EDuration="18.277201478s" totalImagesPullingTime="1.902597718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:57.276123871 +0000 UTC m=+129.033293359" watchObservedRunningTime="2026-07-06 19:27:57.277201478 +0000 UTC m=+129.034370965" Jul 06 19:27:58.561966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:58.561934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:27:58.564195 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:58.564175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2dc6a353-8356-4f38-bce0-bad1793051e4-metrics-certs\") pod \"network-metrics-daemon-fg2cc\" (UID: \"2dc6a353-8356-4f38-bce0-bad1793051e4\") " pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:27:58.626302 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:58.626275 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmvz5\"" Jul 06 19:27:58.632522 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:58.632501 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fg2cc" Jul 06 19:27:58.792064 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:58.792032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fg2cc"] Jul 06 19:27:58.796854 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:27:58.796829 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc6a353_8356_4f38_bce0_bad1793051e4.slice/crio-d2e1d1f0b6ea7e718507c8eddc7a436c6a55788b3d3700e00d39c33baa692575 WatchSource:0}: Error finding container d2e1d1f0b6ea7e718507c8eddc7a436c6a55788b3d3700e00d39c33baa692575: Status 404 returned error can't find the container with id d2e1d1f0b6ea7e718507c8eddc7a436c6a55788b3d3700e00d39c33baa692575 Jul 06 19:27:59.264762 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.264730 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fg2cc" event={"ID":"2dc6a353-8356-4f38-bce0-bad1793051e4","Type":"ContainerStarted","Data":"d2e1d1f0b6ea7e718507c8eddc7a436c6a55788b3d3700e00d39c33baa692575"} Jul 06 19:27:59.672127 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.672088 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:59.672519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.672190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:59.672794 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.672773 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11fac460-bb97-487e-8adf-35bcc2164b86-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:59.674356 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.674337 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11fac460-bb97-487e-8adf-35bcc2164b86-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-279sr\" (UID: \"11fac460-bb97-487e-8adf-35bcc2164b86\") " pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:59.692752 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.692717 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtdxx\"" Jul 06 19:27:59.700614 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.700590 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-279sr" Jul 06 19:27:59.844770 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:27:59.844732 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-279sr"] Jul 06 19:27:59.982487 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:27:59.982387 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11fac460_bb97_487e_8adf_35bcc2164b86.slice/crio-99f85bc6068ae33667e11d99373da450de2b5c3fb3a7b0631e7bb356e51c60af WatchSource:0}: Error finding container 99f85bc6068ae33667e11d99373da450de2b5c3fb3a7b0631e7bb356e51c60af: Status 404 returned error can't find the container with id 99f85bc6068ae33667e11d99373da450de2b5c3fb3a7b0631e7bb356e51c60af Jul 06 19:28:00.269448 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:00.269346 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fg2cc" event={"ID":"2dc6a353-8356-4f38-bce0-bad1793051e4","Type":"ContainerStarted","Data":"1eb137a1c526c4db2717d3aea279dd9a5e045c26549ec2c54d784212f7059d95"} Jul 06 19:28:00.269448 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:00.269408 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fg2cc" event={"ID":"2dc6a353-8356-4f38-bce0-bad1793051e4","Type":"ContainerStarted","Data":"34931d719a922910bf3bb469de713e87b53b0be763646fe579b2018ae68d86da"} Jul 06 19:28:00.270441 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:00.270422 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-279sr" event={"ID":"11fac460-bb97-487e-8adf-35bcc2164b86","Type":"ContainerStarted","Data":"99f85bc6068ae33667e11d99373da450de2b5c3fb3a7b0631e7bb356e51c60af"} Jul 06 19:28:00.287495 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:00.287445 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fg2cc" podStartSLOduration=130.080383524 podStartE2EDuration="2m11.287426883s" totalImagesPullingTime="1.207043359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:00.286992789 +0000 UTC m=+132.044162277" watchObservedRunningTime="2026-07-06 19:28:00.287426883 +0000 UTC m=+132.044596373" Jul 06 19:28:04.288990 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:04.288958 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-279sr" event={"ID":"11fac460-bb97-487e-8adf-35bcc2164b86","Type":"ContainerStarted","Data":"b679862d56cdbdb5c4d0c56c0bb538cba0693a50a373b944404e86528615a455"} Jul 06 19:28:04.289356 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:04.289015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-279sr" event={"ID":"11fac460-bb97-487e-8adf-35bcc2164b86","Type":"ContainerStarted","Data":"6625c096612d3f2fd5a0b9bf60d5cf2cdcaf439376503cae0428229a7c0360c9"} Jul 06 19:28:06.606117 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.606082 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-cdpmb"] Jul 06 19:28:06.607945 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.607930 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-cdpmb" Jul 06 19:28:06.610014 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.609997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:28:06.610277 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.610260 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-nbrdc\"" Jul 06 19:28:06.610723 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.610704 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:28:06.635072 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.635051 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-cdpmb"] Jul 06 19:28:06.730401 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.730363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kswxz\" (UniqueName: \"kubernetes.io/projected/daf24101-2b0d-4ba3-a2ae-f27dcf2728a1-kube-api-access-kswxz\") pod \"downloads-685bfb5f64-cdpmb\" (UID: \"daf24101-2b0d-4ba3-a2ae-f27dcf2728a1\") " pod="openshift-console/downloads-685bfb5f64-cdpmb" Jul 06 19:28:06.830998 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.830921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kswxz\" (UniqueName: \"kubernetes.io/projected/daf24101-2b0d-4ba3-a2ae-f27dcf2728a1-kube-api-access-kswxz\") pod \"downloads-685bfb5f64-cdpmb\" (UID: \"daf24101-2b0d-4ba3-a2ae-f27dcf2728a1\") " pod="openshift-console/downloads-685bfb5f64-cdpmb" Jul 06 19:28:06.850108 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.850070 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kswxz\" (UniqueName: \"kubernetes.io/projected/daf24101-2b0d-4ba3-a2ae-f27dcf2728a1-kube-api-access-kswxz\") pod \"downloads-685bfb5f64-cdpmb\" (UID: \"daf24101-2b0d-4ba3-a2ae-f27dcf2728a1\") " pod="openshift-console/downloads-685bfb5f64-cdpmb" Jul 06 19:28:06.915650 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:06.915620 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-cdpmb" Jul 06 19:28:07.039434 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:07.039406 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-cdpmb"] Jul 06 19:28:07.042094 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:07.042058 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf24101_2b0d_4ba3_a2ae_f27dcf2728a1.slice/crio-5aeab19d91e716de1709dc7bd02cb2734e975502fd33e327a70ba227153fcc54 WatchSource:0}: Error finding container 5aeab19d91e716de1709dc7bd02cb2734e975502fd33e327a70ba227153fcc54: Status 404 returned error can't find the container with id 5aeab19d91e716de1709dc7bd02cb2734e975502fd33e327a70ba227153fcc54 Jul 06 19:28:07.300721 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:07.300686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-279sr" event={"ID":"11fac460-bb97-487e-8adf-35bcc2164b86","Type":"ContainerStarted","Data":"f62c3193d9ae504ea1d134d040c0b497f1868ebf73266412e655e7641cef87f6"} Jul 06 19:28:07.301745 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:07.301720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-cdpmb" event={"ID":"daf24101-2b0d-4ba3-a2ae-f27dcf2728a1","Type":"ContainerStarted","Data":"5aeab19d91e716de1709dc7bd02cb2734e975502fd33e327a70ba227153fcc54"} Jul 06 19:28:07.326093 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:07.326050 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-279sr" podStartSLOduration=17.880873662 podStartE2EDuration="24.326036482s" totalImagesPullingTime="6.44516282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:07.325130353 +0000 UTC m=+139.082299844" watchObservedRunningTime="2026-07-06 19:28:07.326036482 +0000 UTC m=+139.083205971" Jul 06 19:28:10.760032 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:10.759992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:28:10.760680 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:10.760655 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b86f430-aedd-43ae-a4fa-9bc4de23dc8b-service-ca-bundle\") pod \"router-default-b4ccd844f-dqkq6\" (UID: \"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b\") " pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:28:11.031886 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:11.031816 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-dgmg2\"" Jul 06 19:28:11.040528 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:11.040505 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:28:11.182384 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:11.182356 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-b4ccd844f-dqkq6"] Jul 06 19:28:11.184936 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:11.184901 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b86f430_aedd_43ae_a4fa_9bc4de23dc8b.slice/crio-096f7dedbfe44c4888ed052395a5b1e17100a316e3ab520ebd3bb37f956ce9cf WatchSource:0}: Error finding container 096f7dedbfe44c4888ed052395a5b1e17100a316e3ab520ebd3bb37f956ce9cf: Status 404 returned error can't find the container with id 096f7dedbfe44c4888ed052395a5b1e17100a316e3ab520ebd3bb37f956ce9cf Jul 06 19:28:11.317370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:11.317278 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" event={"ID":"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b","Type":"ContainerStarted","Data":"e3dabd0a7a8819ecd4ac4e280ca5bae96e6b86749b445868dde4b4bb6b9d8052"} Jul 06 19:28:11.317370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:11.317342 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" event={"ID":"1b86f430-aedd-43ae-a4fa-9bc4de23dc8b","Type":"ContainerStarted","Data":"096f7dedbfe44c4888ed052395a5b1e17100a316e3ab520ebd3bb37f956ce9cf"} Jul 06 19:28:11.335916 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:11.335776 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" podStartSLOduration=33.335760631 podStartE2EDuration="33.335760631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:11.334946559 +0000 UTC m=+143.092116047" watchObservedRunningTime="2026-07-06 19:28:11.335760631 +0000 UTC m=+143.092930119" Jul 06 19:28:12.041585 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:12.041552 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:28:12.044067 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:12.044044 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:28:12.321254 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:12.321173 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:28:12.322533 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:12.322495 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-b4ccd844f-dqkq6" Jul 06 19:28:13.913260 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:13.913231 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74"] Jul 06 19:28:13.917048 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:13.917027 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:13.919130 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:13.919098 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 19:28:13.919253 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:13.919193 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ndjrv\"" Jul 06 19:28:13.924051 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:13.924030 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74"] Jul 06 19:28:13.988044 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:13.988015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22a558fe-e459-4600-a837-65aa08d2a147-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pzn74\" (UID: \"22a558fe-e459-4600-a837-65aa08d2a147\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:14.088665 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.088642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22a558fe-e459-4600-a837-65aa08d2a147-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pzn74\" (UID: \"22a558fe-e459-4600-a837-65aa08d2a147\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:14.088788 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:14.088772 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 19:28:14.088842 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:14.088832 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22a558fe-e459-4600-a837-65aa08d2a147-tls-certificates podName:22a558fe-e459-4600-a837-65aa08d2a147 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:14.588817017 +0000 UTC m=+146.345986487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/22a558fe-e459-4600-a837-65aa08d2a147-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-pzn74" (UID: "22a558fe-e459-4600-a837-65aa08d2a147") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 19:28:14.333470 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.333385 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6d9c9796-s8p24"] Jul 06 19:28:14.336796 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.336775 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.338946 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.338928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:28:14.339053 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.338992 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:28:14.339608 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.339574 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:28:14.339608 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.339574 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:28:14.339725 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.339575 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zpmgh\"" Jul 06 19:28:14.339725 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.339716 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:28:14.352650 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.351505 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:28:14.354956 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.354935 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6d9c9796-s8p24"] Jul 06 19:28:14.391099 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.391070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-console-config\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.391398 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.391374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-service-ca\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.391519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.391424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-trusted-ca-bundle\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.391597 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.391572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6p98\" (UniqueName: \"kubernetes.io/projected/7197626a-8259-4870-aadb-fb17ce0a61e3-kube-api-access-s6p98\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.391638 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.391611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-oauth-config\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.391679 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.391648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-oauth-serving-cert\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.391716 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.391699 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-serving-cert\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.492828 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.492797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-service-ca\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.492966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.492842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-trusted-ca-bundle\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.492966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.492880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6p98\" (UniqueName: \"kubernetes.io/projected/7197626a-8259-4870-aadb-fb17ce0a61e3-kube-api-access-s6p98\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.492966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.492900 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-oauth-config\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.492966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.492915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-oauth-serving-cert\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.492966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.492940 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-serving-cert\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.493276 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.493244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-console-config\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.493690 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.493665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-service-ca\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.493809 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.493793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-trusted-ca-bundle\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.493891 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.493869 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-console-config\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.493954 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.493890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-oauth-serving-cert\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.495510 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.495486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-oauth-config\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.495697 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.495681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-serving-cert\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.501829 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.501789 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6p98\" (UniqueName: \"kubernetes.io/projected/7197626a-8259-4870-aadb-fb17ce0a61e3-kube-api-access-s6p98\") pod \"console-5c6d9c9796-s8p24\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.593847 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.593788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22a558fe-e459-4600-a837-65aa08d2a147-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pzn74\" (UID: \"22a558fe-e459-4600-a837-65aa08d2a147\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:14.595813 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.595794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/22a558fe-e459-4600-a837-65aa08d2a147-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-pzn74\" (UID: \"22a558fe-e459-4600-a837-65aa08d2a147\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:14.647747 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.647721 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:14.789117 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.789087 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6d9c9796-s8p24"] Jul 06 19:28:14.791918 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:14.791887 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7197626a_8259_4870_aadb_fb17ce0a61e3.slice/crio-08a4e66708a1d585cf1177da372e99719cc480181aa7b5c415dcb4bc8348c4b8 WatchSource:0}: Error finding container 08a4e66708a1d585cf1177da372e99719cc480181aa7b5c415dcb4bc8348c4b8: Status 404 returned error can't find the container with id 08a4e66708a1d585cf1177da372e99719cc480181aa7b5c415dcb4bc8348c4b8 Jul 06 19:28:14.827515 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.827489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:14.977930 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:14.977903 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74"] Jul 06 19:28:14.980828 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:14.980798 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a558fe_e459_4600_a837_65aa08d2a147.slice/crio-68b26036e2562a5c532601c5cb61a80fb54880b0736616a8782b9149d602fd25 WatchSource:0}: Error finding container 68b26036e2562a5c532601c5cb61a80fb54880b0736616a8782b9149d602fd25: Status 404 returned error can't find the container with id 68b26036e2562a5c532601c5cb61a80fb54880b0736616a8782b9149d602fd25 Jul 06 19:28:15.331957 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:15.331839 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6d9c9796-s8p24" event={"ID":"7197626a-8259-4870-aadb-fb17ce0a61e3","Type":"ContainerStarted","Data":"08a4e66708a1d585cf1177da372e99719cc480181aa7b5c415dcb4bc8348c4b8"} Jul 06 19:28:15.333489 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:15.333458 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" event={"ID":"22a558fe-e459-4600-a837-65aa08d2a147","Type":"ContainerStarted","Data":"68b26036e2562a5c532601c5cb61a80fb54880b0736616a8782b9149d602fd25"} Jul 06 19:28:18.345386 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:18.345355 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6d9c9796-s8p24" event={"ID":"7197626a-8259-4870-aadb-fb17ce0a61e3","Type":"ContainerStarted","Data":"1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf"} Jul 06 19:28:18.346748 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:18.346727 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" event={"ID":"22a558fe-e459-4600-a837-65aa08d2a147","Type":"ContainerStarted","Data":"3fdbbcd0c4f2844e81a9334b7801056b3579517cdf35e6c523161cdc5e84f3c9"} Jul 06 19:28:18.346905 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:18.346892 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:18.351361 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:18.351345 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" Jul 06 19:28:18.367786 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:18.367742 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6d9c9796-s8p24" podStartSLOduration=1.199630717 podStartE2EDuration="4.367728491s" totalImagesPullingTime="3.168097774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:18.36664075 +0000 UTC m=+150.123810270" watchObservedRunningTime="2026-07-06 19:28:18.367728491 +0000 UTC m=+150.124897960" Jul 06 19:28:18.390700 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:18.390657 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-pzn74" podStartSLOduration=2.599198089 podStartE2EDuration="5.390641012s" totalImagesPullingTime="2.791442923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:18.388925468 +0000 UTC m=+150.146094956" watchObservedRunningTime="2026-07-06 19:28:18.390641012 +0000 UTC m=+150.147810502" Jul 06 19:28:23.869103 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.869065 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65"] Jul 06 19:28:23.872239 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.872211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:23.896984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.896807 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:28:23.896984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.896865 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:28:23.896984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.896869 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:28:23.897453 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.897434 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hdjpr\"" Jul 06 19:28:23.897509 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.897464 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:28:23.897577 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.897560 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 19:28:23.897729 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.897708 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 19:28:23.916601 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.916575 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65"] Jul 06 19:28:23.966103 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.966068 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2qpkj"] Jul 06 19:28:23.968604 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.968583 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:23.974383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.974352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:23.974502 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.974410 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:23.974502 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.974463 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:23.974502 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.974489 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z85j\" (UniqueName: \"kubernetes.io/projected/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-api-access-7z85j\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:23.974649 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.974521 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:23.974649 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.974576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:23.975320 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.975293 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:28:23.975587 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.975571 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:28:23.975839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.975819 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:28:23.976042 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:23.976027 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hnkzb\"" Jul 06 19:28:24.075518 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075481 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.075518 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z85j\" (UniqueName: \"kubernetes.io/projected/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-api-access-7z85j\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.075760 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.075760 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075659 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s69l\" (UniqueName: \"kubernetes.io/projected/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-kube-api-access-6s69l\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.075760 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.075760 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075714 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.075760 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-wtmp\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.076008 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.076008 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-sys\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.076008 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075912 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-root\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.076008 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.075963 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.076008 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.076000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.076299 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.076037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-metrics-client-ca\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.076299 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.076066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.076299 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.076068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.076299 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.076090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-textfile\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.076493 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.076410 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.076648 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.076607 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.078532 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.078508 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.078637 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.078562 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.092304 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.092284 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z85j\" (UniqueName: \"kubernetes.io/projected/716ab8b2-cd5d-4189-8112-d4cc2f3528b3-kube-api-access-7z85j\") pod \"kube-state-metrics-7c9dbb8b7d-wmn65\" (UID: \"716ab8b2-cd5d-4189-8112-d4cc2f3528b3\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.177182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177137 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s69l\" (UniqueName: \"kubernetes.io/projected/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-kube-api-access-6s69l\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177487 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-wtmp\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177487 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177487 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177282 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-sys\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177487 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-root\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177487 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177360 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177487 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-metrics-client-ca\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177487 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-textfile\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177822 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-sys\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177822 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177645 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-root\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177822 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177654 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-wtmp\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177822 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:24.177742 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 19:28:24.177822 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.177741 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-textfile\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.177822 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:24.177818 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls podName:5a1ae032-2f27-4d6f-b91d-9592fb3dada9 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:24.677799029 +0000 UTC m=+156.434968511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls") pod "node-exporter-2qpkj" (UID: "5a1ae032-2f27-4d6f-b91d-9592fb3dada9") : secret "node-exporter-tls" not found Jul 06 19:28:24.178198 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.178175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-metrics-client-ca\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.178283 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.178175 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-accelerators-collector-config\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.180053 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.180028 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.183040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.183019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" Jul 06 19:28:24.224469 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.224440 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s69l\" (UniqueName: \"kubernetes.io/projected/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-kube-api-access-6s69l\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.648482 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.648448 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:24.649276 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.649209 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:24.649800 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.649494 2563 patch_prober.go:28] interesting pod/console-5c6d9c9796-s8p24 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 06 19:28:24.649800 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.649544 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5c6d9c9796-s8p24" podUID="7197626a-8259-4870-aadb-fb17ce0a61e3" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 06 19:28:24.681383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.681354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:24.681532 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:24.681512 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 19:28:24.681611 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:24.681600 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls podName:5a1ae032-2f27-4d6f-b91d-9592fb3dada9 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:25.681579286 +0000 UTC m=+157.438748769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls") pod "node-exporter-2qpkj" (UID: "5a1ae032-2f27-4d6f-b91d-9592fb3dada9") : secret "node-exporter-tls" not found Jul 06 19:28:24.905755 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.905681 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:28:24.908769 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.908742 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.913407 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.913382 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:28:24.913534 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.913413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-7qtpr\"" Jul 06 19:28:24.914429 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.914405 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:28:24.914429 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.914422 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:28:24.914581 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.914422 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:28:24.914910 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.914785 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:28:24.914910 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.914799 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:28:24.914910 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.914866 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:28:24.915459 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.915301 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:28:24.917883 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.917861 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:28:24.942434 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.942380 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:28:24.983615 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983724 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983629 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983724 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983834 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjncs\" (UniqueName: \"kubernetes.io/projected/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-kube-api-access-fjncs\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983834 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983770 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983834 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983982 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983888 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-config-out\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983982 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.983982 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.983966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-web-config\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.984124 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.984006 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.984124 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.984063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.984124 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.984086 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:24.984124 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:24.984114 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.084823 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.084792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjncs\" (UniqueName: \"kubernetes.io/projected/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-kube-api-access-fjncs\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085005 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.084836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085005 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.084863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085005 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.084927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-config-out\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085005 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.084957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085005 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.084982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-web-config\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085460 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085019 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085460 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085059 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085460 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085085 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085460 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085460 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085460 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085261 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085460 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085299 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085841 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085647 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.085920 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.085899 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.086079 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:25.086036 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-trusted-ca-bundle podName:1a1cbc23-6f8a-4111-948c-075d1d7d5cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:25.586014114 +0000 UTC m=+157.343183628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1a1cbc23-6f8a-4111-948c-075d1d7d5cd4") : configmap references non-existent config key: ca-bundle.crt Jul 06 19:28:25.088816 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.088638 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.088816 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:25.088736 2563 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 06 19:28:25.088816 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:25.088792 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-main-tls podName:1a1cbc23-6f8a-4111-948c-075d1d7d5cd4 nodeName:}" failed. No retries permitted until 2026-07-06 19:28:25.588773162 +0000 UTC m=+157.345942637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1a1cbc23-6f8a-4111-948c-075d1d7d5cd4") : secret "alertmanager-main-tls" not found Jul 06 19:28:25.089203 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.089172 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-config-out\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.089343 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.089267 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-web-config\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.089772 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.089727 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.089976 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.089934 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.091025 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.091004 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.091566 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.091527 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.092123 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.092081 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.119299 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.119276 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjncs\" (UniqueName: \"kubernetes.io/projected/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-kube-api-access-fjncs\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.590104 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.590063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.590317 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.590112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.590916 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.590879 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.592669 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.592646 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a1cbc23-6f8a-4111-948c-075d1d7d5cd4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:25.691047 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.691012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:25.693461 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.693428 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a1ae032-2f27-4d6f-b91d-9592fb3dada9-node-exporter-tls\") pod \"node-exporter-2qpkj\" (UID: \"5a1ae032-2f27-4d6f-b91d-9592fb3dada9\") " pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:25.778777 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.778740 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2qpkj" Jul 06 19:28:25.820343 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:25.820313 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:28:26.136754 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:26.136717 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-l94z7" podUID="5c233f07-695a-4fb6-a84f-cf7a0bad9152" Jul 06 19:28:26.246285 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:26.246250 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a1ae032_2f27_4d6f_b91d_9592fb3dada9.slice/crio-1235a36fa9d56d4da61a3a30efc52ecef43fd19c9652903be0d49e9c19afa328 WatchSource:0}: Error finding container 1235a36fa9d56d4da61a3a30efc52ecef43fd19c9652903be0d49e9c19afa328: Status 404 returned error can't find the container with id 1235a36fa9d56d4da61a3a30efc52ecef43fd19c9652903be0d49e9c19afa328 Jul 06 19:28:26.376820 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:26.376794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qpkj" event={"ID":"5a1ae032-2f27-4d6f-b91d-9592fb3dada9","Type":"ContainerStarted","Data":"1235a36fa9d56d4da61a3a30efc52ecef43fd19c9652903be0d49e9c19afa328"} Jul 06 19:28:26.376917 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:26.376805 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l94z7" Jul 06 19:28:26.390197 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:26.390177 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65"] Jul 06 19:28:26.394137 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:26.394116 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:28:26.394352 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:26.394318 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod716ab8b2_cd5d_4189_8112_d4cc2f3528b3.slice/crio-65ab694bdcbf504abe0d20f7f63c8b348f251f2a9f29814fa8666101ab8fe7f8 WatchSource:0}: Error finding container 65ab694bdcbf504abe0d20f7f63c8b348f251f2a9f29814fa8666101ab8fe7f8: Status 404 returned error can't find the container with id 65ab694bdcbf504abe0d20f7f63c8b348f251f2a9f29814fa8666101ab8fe7f8 Jul 06 19:28:26.396596 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:26.396576 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1cbc23_6f8a_4111_948c_075d1d7d5cd4.slice/crio-7cbdfff86da0bf7b80bab991aa23da74f81eb2ea24fe489fb7bdbe392dcfe0cd WatchSource:0}: Error finding container 7cbdfff86da0bf7b80bab991aa23da74f81eb2ea24fe489fb7bdbe392dcfe0cd: Status 404 returned error can't find the container with id 7cbdfff86da0bf7b80bab991aa23da74f81eb2ea24fe489fb7bdbe392dcfe0cd Jul 06 19:28:27.386317 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:27.386273 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-cdpmb" event={"ID":"daf24101-2b0d-4ba3-a2ae-f27dcf2728a1","Type":"ContainerStarted","Data":"53d1c2e8d5f3d55f8ba00e7a2237ed5dab222acfb3328ab63fc8e3fa64b6beff"} Jul 06 19:28:27.386956 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:27.386641 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-cdpmb" Jul 06 19:28:27.389678 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:27.389647 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" event={"ID":"716ab8b2-cd5d-4189-8112-d4cc2f3528b3","Type":"ContainerStarted","Data":"65ab694bdcbf504abe0d20f7f63c8b348f251f2a9f29814fa8666101ab8fe7f8"} Jul 06 19:28:27.392926 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:27.392835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerStarted","Data":"7cbdfff86da0bf7b80bab991aa23da74f81eb2ea24fe489fb7bdbe392dcfe0cd"} Jul 06 19:28:27.396881 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:27.396833 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-cdpmb" Jul 06 19:28:27.408207 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:27.408140 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-cdpmb" podStartSLOduration=2.102655292 podStartE2EDuration="21.408122371s" totalImagesPullingTime="19.305467079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:27.407064709 +0000 UTC m=+159.164234228" watchObservedRunningTime="2026-07-06 19:28:27.408122371 +0000 UTC m=+159.165291860" Jul 06 19:28:28.399104 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.399069 2563 generic.go:356] "Generic (PLEG): container finished" podID="5a1ae032-2f27-4d6f-b91d-9592fb3dada9" containerID="108e3b86b9a3c22cb8fa89e3ac1fad4b3718c65706c52a8c572eea13b243fcdf" exitCode=0 Jul 06 19:28:28.399566 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.399173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qpkj" event={"ID":"5a1ae032-2f27-4d6f-b91d-9592fb3dada9","Type":"ContainerDied","Data":"108e3b86b9a3c22cb8fa89e3ac1fad4b3718c65706c52a8c572eea13b243fcdf"} Jul 06 19:28:28.821036 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.821012 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58f867bddc-gxhcg"] Jul 06 19:28:28.840489 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.840465 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:28.844005 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.843976 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f867bddc-gxhcg"] Jul 06 19:28:28.922519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.922031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wbdv\" (UniqueName: \"kubernetes.io/projected/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-kube-api-access-7wbdv\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:28.922519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.922087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-service-ca\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:28.922519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.922134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-serving-cert\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:28.922519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.922217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-oauth-config\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:28.922519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.922300 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-config\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:28.922519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.922324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-trusted-ca-bundle\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:28.922519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:28.922353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-oauth-serving-cert\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.024346 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.024243 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-service-ca\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.023484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-service-ca\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.028378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-serving-cert\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.028422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-oauth-config\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.028508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-config\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.028532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-trusted-ca-bundle\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.028559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-oauth-serving-cert\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.028676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wbdv\" (UniqueName: \"kubernetes.io/projected/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-kube-api-access-7wbdv\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029715 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.029668 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-config\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.029925 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.029869 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-oauth-serving-cert\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.030805 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.030784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-trusted-ca-bundle\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.031754 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.031725 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-serving-cert\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.035883 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.035857 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-oauth-config\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.047040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.047013 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wbdv\" (UniqueName: \"kubernetes.io/projected/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-kube-api-access-7wbdv\") pod \"console-58f867bddc-gxhcg\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.127489 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.125822 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-668887b86b-bxnww"] Jul 06 19:28:29.140060 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.140031 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.144827 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.144631 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 19:28:29.144827 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.144693 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 19:28:29.145054 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.144874 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9lmjw\"" Jul 06 19:28:29.145054 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.144949 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 19:28:29.145054 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.144993 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 19:28:29.145054 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.145007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 19:28:29.149771 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.149743 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 19:28:29.153403 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.153385 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-668887b86b-bxnww"] Jul 06 19:28:29.156959 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.156938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:29.231888 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.231851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.232139 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.232118 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-serving-certs-ca-bundle\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.232328 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.232314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-telemeter-client-tls\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.232452 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.232437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-secret-telemeter-client\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.232541 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.232530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljsbr\" (UniqueName: \"kubernetes.io/projected/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-kube-api-access-ljsbr\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.232682 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.232670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-federate-client-tls\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.232765 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.232754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-metrics-client-ca\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.232860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.232846 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334307 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334271 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-federate-client-tls\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334523 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334503 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-metrics-client-ca\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334624 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334677 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334619 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334677 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-serving-certs-ca-bundle\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334775 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-telemeter-client-tls\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334775 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334760 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-secret-telemeter-client\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.334869 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.334791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljsbr\" (UniqueName: \"kubernetes.io/projected/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-kube-api-access-ljsbr\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.335573 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.335545 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-metrics-client-ca\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.335803 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.335782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.336252 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.335929 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-serving-certs-ca-bundle\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.338299 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.338278 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.338834 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.338816 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-federate-client-tls\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.338932 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.338879 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-telemeter-client-tls\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.340617 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.340595 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-secret-telemeter-client\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.346018 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.345994 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljsbr\" (UniqueName: \"kubernetes.io/projected/b11beb49-9f9d-49a1-91d9-3045ab20bf2b-kube-api-access-ljsbr\") pod \"telemeter-client-668887b86b-bxnww\" (UID: \"b11beb49-9f9d-49a1-91d9-3045ab20bf2b\") " pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.355854 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.355801 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58f867bddc-gxhcg"] Jul 06 19:28:29.359120 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:29.359096 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05df618d_b2b3_4e9b_b2e0_9afda75cd93b.slice/crio-ff0c49867a7efb33219a94596742479b6051a89e5c2a8e0e1a5386d730141500 WatchSource:0}: Error finding container ff0c49867a7efb33219a94596742479b6051a89e5c2a8e0e1a5386d730141500: Status 404 returned error can't find the container with id ff0c49867a7efb33219a94596742479b6051a89e5c2a8e0e1a5386d730141500 Jul 06 19:28:29.406470 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.405753 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" event={"ID":"716ab8b2-cd5d-4189-8112-d4cc2f3528b3","Type":"ContainerStarted","Data":"a5c019ee5bf127c6c497d8527e0a4f8e4ed08a1a465db5e56490f51c455132c8"} Jul 06 19:28:29.406470 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.405816 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" event={"ID":"716ab8b2-cd5d-4189-8112-d4cc2f3528b3","Type":"ContainerStarted","Data":"306b4387de50ccf5630f11b711678dbf50c306093466560aad7ac00c7b17f5c2"} Jul 06 19:28:29.406470 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.405847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" event={"ID":"716ab8b2-cd5d-4189-8112-d4cc2f3528b3","Type":"ContainerStarted","Data":"a344814fd415228621010b1c6e29d7746d8ba49e2e60b21f61b09e0741b3a73b"} Jul 06 19:28:29.409470 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.409445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qpkj" event={"ID":"5a1ae032-2f27-4d6f-b91d-9592fb3dada9","Type":"ContainerStarted","Data":"877461a573e280c51f81ee96ec32eb853799f9fbe6e29e5125ccdbb81b5d5476"} Jul 06 19:28:29.409659 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.409635 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2qpkj" event={"ID":"5a1ae032-2f27-4d6f-b91d-9592fb3dada9","Type":"ContainerStarted","Data":"8d0ca03f8d37bea3a054fd4f1602a53f5675f69970ee8258a84f30cfd0d24553"} Jul 06 19:28:29.411066 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.411042 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a1cbc23-6f8a-4111-948c-075d1d7d5cd4" containerID="8b8aec096769a30a048b4aea1eb867bad4487668625c3d21f48bdaa3a1e98432" exitCode=0 Jul 06 19:28:29.411178 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.411117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerDied","Data":"8b8aec096769a30a048b4aea1eb867bad4487668625c3d21f48bdaa3a1e98432"} Jul 06 19:28:29.412608 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.412587 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f867bddc-gxhcg" event={"ID":"05df618d-b2b3-4e9b-b2e0-9afda75cd93b","Type":"ContainerStarted","Data":"ff0c49867a7efb33219a94596742479b6051a89e5c2a8e0e1a5386d730141500"} Jul 06 19:28:29.431733 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.431563 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-wmn65" podStartSLOduration=4.126013206 podStartE2EDuration="6.431548993s" totalImagesPullingTime="2.305535787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:29.429868648 +0000 UTC m=+161.187038137" watchObservedRunningTime="2026-07-06 19:28:29.431548993 +0000 UTC m=+161.188718484" Jul 06 19:28:29.452989 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.452964 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" Jul 06 19:28:29.504177 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.504026 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2qpkj" podStartSLOduration=5.138407062 podStartE2EDuration="6.504000646s" totalImagesPullingTime="1.259449495s" totalInitContainerRuntime="106.144089ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:28:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:29.461318469 +0000 UTC m=+161.218487959" watchObservedRunningTime="2026-07-06 19:28:29.504000646 +0000 UTC m=+161.261170137" Jul 06 19:28:29.623873 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:29.623761 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-668887b86b-bxnww"] Jul 06 19:28:29.626174 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:29.626127 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb11beb49_9f9d_49a1_91d9_3045ab20bf2b.slice/crio-8daf5b28c8f8ce63c42ea0a4583456f5732e54db6243eb7f267e74257bfc454c WatchSource:0}: Error finding container 8daf5b28c8f8ce63c42ea0a4583456f5732e54db6243eb7f267e74257bfc454c: Status 404 returned error can't find the container with id 8daf5b28c8f8ce63c42ea0a4583456f5732e54db6243eb7f267e74257bfc454c Jul 06 19:28:30.419588 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:30.419549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" event={"ID":"b11beb49-9f9d-49a1-91d9-3045ab20bf2b","Type":"ContainerStarted","Data":"8daf5b28c8f8ce63c42ea0a4583456f5732e54db6243eb7f267e74257bfc454c"} Jul 06 19:28:30.421704 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:30.421675 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f867bddc-gxhcg" event={"ID":"05df618d-b2b3-4e9b-b2e0-9afda75cd93b","Type":"ContainerStarted","Data":"0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d"} Jul 06 19:28:30.445580 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:30.445135 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58f867bddc-gxhcg" podStartSLOduration=2.445116697 podStartE2EDuration="2.445116697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:30.441525316 +0000 UTC m=+162.198694806" watchObservedRunningTime="2026-07-06 19:28:30.445116697 +0000 UTC m=+162.202286186" Jul 06 19:28:30.950991 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:30.950718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:28:30.957300 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:30.956816 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c233f07-695a-4fb6-a84f-cf7a0bad9152-metrics-tls\") pod \"dns-default-l94z7\" (UID: \"5c233f07-695a-4fb6-a84f-cf7a0bad9152\") " pod="openshift-dns/dns-default-l94z7" Jul 06 19:28:31.181785 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:31.181570 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cjqsb\"" Jul 06 19:28:31.188993 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:31.188873 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l94z7" Jul 06 19:28:31.457497 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:31.457465 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l94z7"] Jul 06 19:28:32.436383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:32.436311 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l94z7" event={"ID":"5c233f07-695a-4fb6-a84f-cf7a0bad9152","Type":"ContainerStarted","Data":"202239d2b552046c947d2a84eda693e26e4b9455a2dff32179d76c029e02a5d5"} Jul 06 19:28:33.445051 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.445011 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" event={"ID":"b11beb49-9f9d-49a1-91d9-3045ab20bf2b","Type":"ContainerStarted","Data":"55885023cd498666713196976a0ab4fcab3c4c1e65677db077ce500a7411ee71"} Jul 06 19:28:33.445550 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.445081 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" event={"ID":"b11beb49-9f9d-49a1-91d9-3045ab20bf2b","Type":"ContainerStarted","Data":"3f9bddf410ebaca9e98b4578ecd92f3b9705c7bf0c423d75c7d43cf71fc82d88"} Jul 06 19:28:33.445550 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.445106 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" event={"ID":"b11beb49-9f9d-49a1-91d9-3045ab20bf2b","Type":"ContainerStarted","Data":"e5eb872f34de4d740c26065fcce464cb3259e8fcf7b390943220c0a3c825f01e"} Jul 06 19:28:33.449482 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.449424 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerStarted","Data":"fec07ebc78df4ba1e3671f18e39f9f077829087b6ec8cdd0925caee37425e31c"} Jul 06 19:28:33.449594 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.449488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerStarted","Data":"f7db11bcab18a1b595def2ebc3c3b9bdd38171cf7c9d2370ac641b8a592e7880"} Jul 06 19:28:33.449594 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.449525 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerStarted","Data":"bdeb5fa565901ad88ef6321fc8284b7fb61605c40fea295eda2293f2a37640df"} Jul 06 19:28:33.449594 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.449564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerStarted","Data":"3e21705da8cbbfcbeaf13bc18e389f22fb25e24420de81166be3e2797ebddc0b"} Jul 06 19:28:33.449754 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.449601 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerStarted","Data":"006f33ade49a03c21b333985b50e453b8d4236a386fd9a328046041e60f47eeb"} Jul 06 19:28:33.484240 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.484188 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-668887b86b-bxnww" podStartSLOduration=1.341202572 podStartE2EDuration="4.48417234s" totalImagesPullingTime="3.142969768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:33.48086235 +0000 UTC m=+165.238031839" watchObservedRunningTime="2026-07-06 19:28:33.48417234 +0000 UTC m=+165.241341826" Jul 06 19:28:33.601606 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.601572 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6d9c9796-s8p24"] Jul 06 19:28:33.639191 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.639137 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-594f9969c-m64tn"] Jul 06 19:28:33.667796 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.667759 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594f9969c-m64tn"] Jul 06 19:28:33.667962 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.667867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.776735 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.776652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-config\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.776735 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.776721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-service-ca\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.776984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.776748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-trusted-ca-bundle\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.776984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.776786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-oauth-config\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.776984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.776898 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg2zz\" (UniqueName: \"kubernetes.io/projected/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-kube-api-access-qg2zz\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.776984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.776946 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-serving-cert\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.776984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.776978 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-oauth-serving-cert\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.878088 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.878047 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-oauth-config\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.878325 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.878112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg2zz\" (UniqueName: \"kubernetes.io/projected/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-kube-api-access-qg2zz\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.878325 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.878164 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-serving-cert\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.878325 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.878200 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-oauth-serving-cert\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.878325 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.878243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-config\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.878643 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.878611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-service-ca\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.878722 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.878673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-trusted-ca-bundle\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.879169 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.879024 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-config\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.879169 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.879047 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-oauth-serving-cert\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.879489 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.879448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-service-ca\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.879656 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.879546 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-trusted-ca-bundle\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.881503 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.881480 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-oauth-config\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.881656 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.881636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-serving-cert\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.887285 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.887261 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg2zz\" (UniqueName: \"kubernetes.io/projected/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-kube-api-access-qg2zz\") pod \"console-594f9969c-m64tn\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:33.979412 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:33.979336 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:35.247445 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.247376 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-594f9969c-m64tn"] Jul 06 19:28:35.250093 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:28:35.250068 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode75270fc_c4d2_4cc4_9ae0_6ba80ea640c1.slice/crio-5c1ff82e0263d24577e9812c5ca44b8355ed4f13e9db09a6807130efc72cf626 WatchSource:0}: Error finding container 5c1ff82e0263d24577e9812c5ca44b8355ed4f13e9db09a6807130efc72cf626: Status 404 returned error can't find the container with id 5c1ff82e0263d24577e9812c5ca44b8355ed4f13e9db09a6807130efc72cf626 Jul 06 19:28:35.463126 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.463092 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a1cbc23-6f8a-4111-948c-075d1d7d5cd4","Type":"ContainerStarted","Data":"47fd6bd26def2595c06bc50f3e2978a06c8c8aeaf4e1d7195d052b1f684263c8"} Jul 06 19:28:35.464633 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.464605 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f9969c-m64tn" event={"ID":"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1","Type":"ContainerStarted","Data":"a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7"} Jul 06 19:28:35.464760 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.464650 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f9969c-m64tn" event={"ID":"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1","Type":"ContainerStarted","Data":"5c1ff82e0263d24577e9812c5ca44b8355ed4f13e9db09a6807130efc72cf626"} Jul 06 19:28:35.466189 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.466166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l94z7" event={"ID":"5c233f07-695a-4fb6-a84f-cf7a0bad9152","Type":"ContainerStarted","Data":"94b3eb783c427cf7f58815fc56e0fefd9184e8beeff4945441df9c8d994af401"} Jul 06 19:28:35.466276 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.466210 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l94z7" event={"ID":"5c233f07-695a-4fb6-a84f-cf7a0bad9152","Type":"ContainerStarted","Data":"10f3ca2a5916f3322f55f1bc23856e97a266cb8de710332850f77fdc193cd44b"} Jul 06 19:28:35.466276 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.466241 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l94z7" Jul 06 19:28:35.493689 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.493650 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.318257794 podStartE2EDuration="11.493635493s" totalImagesPullingTime="7.136050745s" totalInitContainerRuntime="39.326954ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:35.491871377 +0000 UTC m=+167.249040866" watchObservedRunningTime="2026-07-06 19:28:35.493635493 +0000 UTC m=+167.250804994" Jul 06 19:28:35.514687 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.514648 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-594f9969c-m64tn" podStartSLOduration=2.514634356 podStartE2EDuration="2.514634356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:35.513845649 +0000 UTC m=+167.271015137" watchObservedRunningTime="2026-07-06 19:28:35.514634356 +0000 UTC m=+167.271803844" Jul 06 19:28:35.540584 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:35.540544 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l94z7" podStartSLOduration=128.902142919 podStartE2EDuration="2m12.540529533s" totalImagesPullingTime="3.638386614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:35.540075861 +0000 UTC m=+167.297245351" watchObservedRunningTime="2026-07-06 19:28:35.540529533 +0000 UTC m=+167.297699022" Jul 06 19:28:39.157829 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:39.157797 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:39.158183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:39.157877 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:28:39.159122 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:39.159102 2563 patch_prober.go:28] interesting pod/console-58f867bddc-gxhcg container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jul 06 19:28:39.159183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:39.159165 2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-58f867bddc-gxhcg" podUID="05df618d-b2b3-4e9b-b2e0-9afda75cd93b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jul 06 19:28:43.979870 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:43.979788 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:43.979870 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:43.979843 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:43.984222 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:43.984202 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:44.509776 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:44.509748 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:28:44.563337 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:44.563307 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f867bddc-gxhcg"] Jul 06 19:28:45.472552 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:45.472524 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l94z7" Jul 06 19:28:48.523340 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:48.523308 2563 generic.go:356] "Generic (PLEG): container finished" podID="4704e030-ed0e-4863-9571-371255f1568a" containerID="b563a5f4bab17fc9834e73604fc19692410182c04dc4eecd737170b2c8748619" exitCode=0 Jul 06 19:28:48.523774 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:48.523383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" event={"ID":"4704e030-ed0e-4863-9571-371255f1568a","Type":"ContainerDied","Data":"b563a5f4bab17fc9834e73604fc19692410182c04dc4eecd737170b2c8748619"} Jul 06 19:28:48.523774 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:48.523708 2563 scope.go:117] "RemoveContainer" containerID="b563a5f4bab17fc9834e73604fc19692410182c04dc4eecd737170b2c8748619" Jul 06 19:28:49.529271 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:49.529237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-2kcft" event={"ID":"4704e030-ed0e-4863-9571-371255f1568a","Type":"ContainerStarted","Data":"9f27fd89efcedaf8b06daedc4c71991fff6bde7f6223f5a59ffe5e772a466a09"} Jul 06 19:28:49.806806 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:49.806724 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l94z7_5c233f07-695a-4fb6-a84f-cf7a0bad9152/dns/0.log" Jul 06 19:28:50.010260 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:50.010233 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l94z7_5c233f07-695a-4fb6-a84f-cf7a0bad9152/kube-rbac-proxy/0.log" Jul 06 19:28:51.007605 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:51.007580 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rrngf_16032533-6dfb-4784-b7e5-ae615d9f64a0/dns-node-resolver/0.log" Jul 06 19:28:51.208181 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:51.208139 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b4ccd844f-dqkq6_1b86f430-aedd-43ae-a4fa-9bc4de23dc8b/router/0.log" Jul 06 19:28:51.816055 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:51.816029 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vqkrz_51af992f-db03-4ae9-8760-e1954a587473/serve-healthcheck-canary/0.log" Jul 06 19:28:53.546398 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:53.546366 2563 generic.go:356] "Generic (PLEG): container finished" podID="2ad598f2-dbba-4b4e-9bcb-398593206010" containerID="58bfbc6e645a384ac4a8689ee306876719c78a4011729ffa74d3ab52eb7558d3" exitCode=0 Jul 06 19:28:53.546743 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:53.546438 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" event={"ID":"2ad598f2-dbba-4b4e-9bcb-398593206010","Type":"ContainerDied","Data":"58bfbc6e645a384ac4a8689ee306876719c78a4011729ffa74d3ab52eb7558d3"} Jul 06 19:28:53.546743 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:53.546714 2563 scope.go:117] "RemoveContainer" containerID="58bfbc6e645a384ac4a8689ee306876719c78a4011729ffa74d3ab52eb7558d3" Jul 06 19:28:54.552517 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:54.552483 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-qws9v" event={"ID":"2ad598f2-dbba-4b4e-9bcb-398593206010","Type":"ContainerStarted","Data":"e5a9db59a111a43a28b74b8ce499c9bd9becb0ff631fc0c6e7482a283e544a57"} Jul 06 19:28:58.569839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.569752 2563 generic.go:356] "Generic (PLEG): container finished" podID="a4102759-254e-40eb-bc79-dd9ab5b05cee" containerID="74555845ff8025468db4a10d536390e7835a70b565c9b1cdbb331d210ea223e0" exitCode=0 Jul 06 19:28:58.569839 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.569822 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" event={"ID":"a4102759-254e-40eb-bc79-dd9ab5b05cee","Type":"ContainerDied","Data":"74555845ff8025468db4a10d536390e7835a70b565c9b1cdbb331d210ea223e0"} Jul 06 19:28:58.570249 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.570127 2563 scope.go:117] "RemoveContainer" containerID="74555845ff8025468db4a10d536390e7835a70b565c9b1cdbb331d210ea223e0" Jul 06 19:28:58.626192 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.626161 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c6d9c9796-s8p24" podUID="7197626a-8259-4870-aadb-fb17ce0a61e3" containerName="console" containerID="cri-o://1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf" gracePeriod=15 Jul 06 19:28:58.901502 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.901477 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:58.969333 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969306 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-console-config\") pod \"7197626a-8259-4870-aadb-fb17ce0a61e3\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " Jul 06 19:28:58.969451 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969345 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6p98\" (UniqueName: \"kubernetes.io/projected/7197626a-8259-4870-aadb-fb17ce0a61e3-kube-api-access-s6p98\") pod \"7197626a-8259-4870-aadb-fb17ce0a61e3\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " Jul 06 19:28:58.969451 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969379 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-serving-cert\") pod \"7197626a-8259-4870-aadb-fb17ce0a61e3\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " Jul 06 19:28:58.969572 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969551 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-trusted-ca-bundle\") pod \"7197626a-8259-4870-aadb-fb17ce0a61e3\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " Jul 06 19:28:58.969627 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969611 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-oauth-config\") pod \"7197626a-8259-4870-aadb-fb17ce0a61e3\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " Jul 06 19:28:58.969681 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969655 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-service-ca\") pod \"7197626a-8259-4870-aadb-fb17ce0a61e3\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " Jul 06 19:28:58.969729 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969676 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-console-config" (OuterVolumeSpecName: "console-config") pod "7197626a-8259-4870-aadb-fb17ce0a61e3" (UID: "7197626a-8259-4870-aadb-fb17ce0a61e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:28:58.969729 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969687 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-oauth-serving-cert\") pod \"7197626a-8259-4870-aadb-fb17ce0a61e3\" (UID: \"7197626a-8259-4870-aadb-fb17ce0a61e3\") " Jul 06 19:28:58.969997 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969975 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-console-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:28:58.970125 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.969924 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7197626a-8259-4870-aadb-fb17ce0a61e3" (UID: "7197626a-8259-4870-aadb-fb17ce0a61e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:28:58.970125 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.970092 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "7197626a-8259-4870-aadb-fb17ce0a61e3" (UID: "7197626a-8259-4870-aadb-fb17ce0a61e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:28:58.970125 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.970089 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7197626a-8259-4870-aadb-fb17ce0a61e3" (UID: "7197626a-8259-4870-aadb-fb17ce0a61e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:28:58.971504 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.971484 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7197626a-8259-4870-aadb-fb17ce0a61e3" (UID: "7197626a-8259-4870-aadb-fb17ce0a61e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:28:58.971620 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.971605 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7197626a-8259-4870-aadb-fb17ce0a61e3" (UID: "7197626a-8259-4870-aadb-fb17ce0a61e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:28:58.971669 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:58.971634 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7197626a-8259-4870-aadb-fb17ce0a61e3-kube-api-access-s6p98" (OuterVolumeSpecName: "kube-api-access-s6p98") pod "7197626a-8259-4870-aadb-fb17ce0a61e3" (UID: "7197626a-8259-4870-aadb-fb17ce0a61e3"). InnerVolumeSpecName "kube-api-access-s6p98". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:28:59.070317 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.070294 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6p98\" (UniqueName: \"kubernetes.io/projected/7197626a-8259-4870-aadb-fb17ce0a61e3-kube-api-access-s6p98\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:28:59.070317 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.070315 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:28:59.070468 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.070324 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-trusted-ca-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:28:59.070468 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.070332 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7197626a-8259-4870-aadb-fb17ce0a61e3-console-oauth-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:28:59.070468 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.070341 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-service-ca\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:28:59.070468 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.070349 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7197626a-8259-4870-aadb-fb17ce0a61e3-oauth-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:28:59.576370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.576285 2563 generic.go:356] "Generic (PLEG): container finished" podID="7197626a-8259-4870-aadb-fb17ce0a61e3" containerID="1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf" exitCode=0 Jul 06 19:28:59.576370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.576335 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6d9c9796-s8p24" Jul 06 19:28:59.576857 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.576374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6d9c9796-s8p24" event={"ID":"7197626a-8259-4870-aadb-fb17ce0a61e3","Type":"ContainerDied","Data":"1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf"} Jul 06 19:28:59.576857 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.576433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6d9c9796-s8p24" event={"ID":"7197626a-8259-4870-aadb-fb17ce0a61e3","Type":"ContainerDied","Data":"08a4e66708a1d585cf1177da372e99719cc480181aa7b5c415dcb4bc8348c4b8"} Jul 06 19:28:59.576857 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.576454 2563 scope.go:117] "RemoveContainer" containerID="1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf" Jul 06 19:28:59.578840 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.578817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-kf9nk" event={"ID":"a4102759-254e-40eb-bc79-dd9ab5b05cee","Type":"ContainerStarted","Data":"170d42775c068c762562eb451274d722ba86c1730fae2c96448f1246361a40c4"} Jul 06 19:28:59.586793 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.586775 2563 scope.go:117] "RemoveContainer" containerID="1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf" Jul 06 19:28:59.587064 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:28:59.587045 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf\": container with ID starting with 1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf not found: ID does not exist" containerID="1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf" Jul 06 19:28:59.587138 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.587072 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf"} err="failed to get container status \"1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf\": rpc error: code = NotFound desc = could not find container \"1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf\": container with ID starting with 1fcb5f57ad5a18f490744b885292c562db1cf45275f12a88ba5e503b841f0ebf not found: ID does not exist" Jul 06 19:28:59.636849 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.636705 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6d9c9796-s8p24"] Jul 06 19:28:59.642305 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:28:59.642214 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6d9c9796-s8p24"] Jul 06 19:29:00.811824 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:00.811786 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7197626a-8259-4870-aadb-fb17ce0a61e3" path="/var/lib/kubelet/pods/7197626a-8259-4870-aadb-fb17ce0a61e3/volumes" Jul 06 19:29:09.583084 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.583046 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58f867bddc-gxhcg" podUID="05df618d-b2b3-4e9b-b2e0-9afda75cd93b" containerName="console" containerID="cri-o://0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d" gracePeriod=15 Jul 06 19:29:09.876801 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.876775 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:29:09.961498 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961473 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-config\") pod \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " Jul 06 19:29:09.961639 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961518 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-oauth-serving-cert\") pod \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " Jul 06 19:29:09.961639 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961542 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wbdv\" (UniqueName: \"kubernetes.io/projected/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-kube-api-access-7wbdv\") pod \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " Jul 06 19:29:09.961639 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961568 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-trusted-ca-bundle\") pod \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " Jul 06 19:29:09.961742 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961679 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-serving-cert\") pod \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " Jul 06 19:29:09.961742 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961714 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-oauth-config\") pod \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " Jul 06 19:29:09.961833 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961768 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-service-ca\") pod \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\" (UID: \"05df618d-b2b3-4e9b-b2e0-9afda75cd93b\") " Jul 06 19:29:09.961894 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961870 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-config" (OuterVolumeSpecName: "console-config") pod "05df618d-b2b3-4e9b-b2e0-9afda75cd93b" (UID: "05df618d-b2b3-4e9b-b2e0-9afda75cd93b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:29:09.961980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.961965 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "05df618d-b2b3-4e9b-b2e0-9afda75cd93b" (UID: "05df618d-b2b3-4e9b-b2e0-9afda75cd93b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:29:09.962097 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.962066 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "05df618d-b2b3-4e9b-b2e0-9afda75cd93b" (UID: "05df618d-b2b3-4e9b-b2e0-9afda75cd93b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:29:09.962319 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.962243 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:29:09.962319 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.962265 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-oauth-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:29:09.962319 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.962277 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-trusted-ca-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:29:09.962319 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.962277 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-service-ca" (OuterVolumeSpecName: "service-ca") pod "05df618d-b2b3-4e9b-b2e0-9afda75cd93b" (UID: "05df618d-b2b3-4e9b-b2e0-9afda75cd93b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:29:09.963709 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.963683 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "05df618d-b2b3-4e9b-b2e0-9afda75cd93b" (UID: "05df618d-b2b3-4e9b-b2e0-9afda75cd93b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:29:09.964072 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.964043 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "05df618d-b2b3-4e9b-b2e0-9afda75cd93b" (UID: "05df618d-b2b3-4e9b-b2e0-9afda75cd93b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:29:09.964169 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:09.964054 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-kube-api-access-7wbdv" (OuterVolumeSpecName: "kube-api-access-7wbdv") pod "05df618d-b2b3-4e9b-b2e0-9afda75cd93b" (UID: "05df618d-b2b3-4e9b-b2e0-9afda75cd93b"). InnerVolumeSpecName "kube-api-access-7wbdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:29:10.063012 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.062989 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-service-ca\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:29:10.063012 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.063013 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wbdv\" (UniqueName: \"kubernetes.io/projected/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-kube-api-access-7wbdv\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:29:10.063139 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.063022 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:29:10.063139 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.063030 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05df618d-b2b3-4e9b-b2e0-9afda75cd93b-console-oauth-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:29:10.628399 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.628364 2563 generic.go:356] "Generic (PLEG): container finished" podID="05df618d-b2b3-4e9b-b2e0-9afda75cd93b" containerID="0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d" exitCode=0 Jul 06 19:29:10.628817 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.628412 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58f867bddc-gxhcg" Jul 06 19:29:10.628817 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.628429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f867bddc-gxhcg" event={"ID":"05df618d-b2b3-4e9b-b2e0-9afda75cd93b","Type":"ContainerDied","Data":"0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d"} Jul 06 19:29:10.628817 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.628467 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58f867bddc-gxhcg" event={"ID":"05df618d-b2b3-4e9b-b2e0-9afda75cd93b","Type":"ContainerDied","Data":"ff0c49867a7efb33219a94596742479b6051a89e5c2a8e0e1a5386d730141500"} Jul 06 19:29:10.628817 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.628487 2563 scope.go:117] "RemoveContainer" containerID="0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d" Jul 06 19:29:10.636853 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.636837 2563 scope.go:117] "RemoveContainer" containerID="0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d" Jul 06 19:29:10.637099 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:29:10.637082 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d\": container with ID starting with 0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d not found: ID does not exist" containerID="0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d" Jul 06 19:29:10.637191 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.637107 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d"} err="failed to get container status \"0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d\": rpc error: code = NotFound desc = could not find container \"0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d\": container with ID starting with 0db8567ffab2213e5380a1dfeb2f69828a6d90bd0a05515974218a71507afe2d not found: ID does not exist" Jul 06 19:29:10.650653 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.650633 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58f867bddc-gxhcg"] Jul 06 19:29:10.657388 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.657368 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58f867bddc-gxhcg"] Jul 06 19:29:10.810285 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:29:10.810258 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05df618d-b2b3-4e9b-b2e0-9afda75cd93b" path="/var/lib/kubelet/pods/05df618d-b2b3-4e9b-b2e0-9afda75cd93b/volumes" Jul 06 19:30:01.641308 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.641278 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9cb54f89-297kc"] Jul 06 19:30:01.641750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.641608 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05df618d-b2b3-4e9b-b2e0-9afda75cd93b" containerName="console" Jul 06 19:30:01.641750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.641619 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="05df618d-b2b3-4e9b-b2e0-9afda75cd93b" containerName="console" Jul 06 19:30:01.641750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.641637 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7197626a-8259-4870-aadb-fb17ce0a61e3" containerName="console" Jul 06 19:30:01.641750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.641642 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7197626a-8259-4870-aadb-fb17ce0a61e3" containerName="console" Jul 06 19:30:01.641750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.641694 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="05df618d-b2b3-4e9b-b2e0-9afda75cd93b" containerName="console" Jul 06 19:30:01.641750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.641701 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7197626a-8259-4870-aadb-fb17ce0a61e3" containerName="console" Jul 06 19:30:01.644355 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.644334 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.650867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.650645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-oauth-config\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.650867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.650690 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-config\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.650867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.650766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-serving-cert\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.650867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.650790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-trusted-ca-bundle\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.650867 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.650833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-service-ca\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.651750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.650943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lvr2\" (UniqueName: \"kubernetes.io/projected/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-kube-api-access-6lvr2\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.651750 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.650998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-oauth-serving-cert\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.677985 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.677955 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cb54f89-297kc"] Jul 06 19:30:01.751759 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.751729 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-serving-cert\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.751759 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.751757 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-trusted-ca-bundle\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.751980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.751784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-service-ca\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.751980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.751819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lvr2\" (UniqueName: \"kubernetes.io/projected/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-kube-api-access-6lvr2\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.751980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.751849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-oauth-serving-cert\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.751980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.751883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-oauth-config\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.751980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.751907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-config\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.752632 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.752603 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-oauth-serving-cert\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.752757 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.752660 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-config\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.752757 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.752660 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-service-ca\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.752932 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.752911 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-trusted-ca-bundle\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.754220 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.754200 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-serving-cert\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.754329 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.754288 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-oauth-config\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.762374 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.762355 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lvr2\" (UniqueName: \"kubernetes.io/projected/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-kube-api-access-6lvr2\") pod \"console-5f9cb54f89-297kc\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:01.953815 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:01.953722 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:02.086235 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:02.086195 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9cb54f89-297kc"] Jul 06 19:30:02.089726 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:30:02.089703 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780feae0_c0c8_4525_ad85_5bcb7ac97f2b.slice/crio-d10eb5d5ebad47532606a925328dbb1bba55cff28294245948427ff9ca297dca WatchSource:0}: Error finding container d10eb5d5ebad47532606a925328dbb1bba55cff28294245948427ff9ca297dca: Status 404 returned error can't find the container with id d10eb5d5ebad47532606a925328dbb1bba55cff28294245948427ff9ca297dca Jul 06 19:30:02.828200 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:02.828166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cb54f89-297kc" event={"ID":"780feae0-c0c8-4525-ad85-5bcb7ac97f2b","Type":"ContainerStarted","Data":"1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc"} Jul 06 19:30:02.828554 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:02.828212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cb54f89-297kc" event={"ID":"780feae0-c0c8-4525-ad85-5bcb7ac97f2b","Type":"ContainerStarted","Data":"d10eb5d5ebad47532606a925328dbb1bba55cff28294245948427ff9ca297dca"} Jul 06 19:30:02.859552 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:02.859509 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f9cb54f89-297kc" podStartSLOduration=1.859495559 podStartE2EDuration="1.859495559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:02.857326853 +0000 UTC m=+254.614496341" watchObservedRunningTime="2026-07-06 19:30:02.859495559 +0000 UTC m=+254.616665049" Jul 06 19:30:11.954738 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:11.954659 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:11.954738 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:11.954719 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:11.959139 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:11.959119 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:12.871403 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:12.871378 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:30:12.939817 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:12.939786 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594f9969c-m64tn"] Jul 06 19:30:37.959602 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:37.959561 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-594f9969c-m64tn" podUID="e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" containerName="console" containerID="cri-o://a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7" gracePeriod=15 Jul 06 19:30:38.208859 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.208836 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:30:38.326097 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326005 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qg2zz\" (UniqueName: \"kubernetes.io/projected/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-kube-api-access-qg2zz\") pod \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " Jul 06 19:30:38.326097 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326054 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-service-ca\") pod \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " Jul 06 19:30:38.326097 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326084 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-trusted-ca-bundle\") pod \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " Jul 06 19:30:38.326378 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326115 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-oauth-serving-cert\") pod \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " Jul 06 19:30:38.326378 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326135 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-config\") pod \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " Jul 06 19:30:38.326378 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326167 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-serving-cert\") pod \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " Jul 06 19:30:38.326378 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326215 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-oauth-config\") pod \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\" (UID: \"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1\") " Jul 06 19:30:38.326621 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326595 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" (UID: "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:30:38.326687 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326617 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" (UID: "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:30:38.326687 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326633 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" (UID: "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:30:38.326778 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.326716 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-config" (OuterVolumeSpecName: "console-config") pod "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" (UID: "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:30:38.328545 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.328517 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" (UID: "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:30:38.328545 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.328535 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-kube-api-access-qg2zz" (OuterVolumeSpecName: "kube-api-access-qg2zz") pod "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" (UID: "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1"). InnerVolumeSpecName "kube-api-access-qg2zz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:30:38.328697 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.328563 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" (UID: "e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:30:38.427216 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.427187 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:30:38.427216 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.427214 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:30:38.427216 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.427222 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-console-oauth-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:30:38.427416 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.427231 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg2zz\" (UniqueName: \"kubernetes.io/projected/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-kube-api-access-qg2zz\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:30:38.427416 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.427240 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-service-ca\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:30:38.427416 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.427248 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-trusted-ca-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:30:38.427416 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.427256 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1-oauth-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:30:38.962160 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.962112 2563 generic.go:356] "Generic (PLEG): container finished" podID="e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" containerID="a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7" exitCode=0 Jul 06 19:30:38.962538 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.962184 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f9969c-m64tn" event={"ID":"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1","Type":"ContainerDied","Data":"a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7"} Jul 06 19:30:38.962538 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.962193 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-594f9969c-m64tn" Jul 06 19:30:38.962538 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.962222 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-594f9969c-m64tn" event={"ID":"e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1","Type":"ContainerDied","Data":"5c1ff82e0263d24577e9812c5ca44b8355ed4f13e9db09a6807130efc72cf626"} Jul 06 19:30:38.962538 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.962241 2563 scope.go:117] "RemoveContainer" containerID="a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7" Jul 06 19:30:38.969942 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.969926 2563 scope.go:117] "RemoveContainer" containerID="a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7" Jul 06 19:30:38.970206 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:30:38.970183 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7\": container with ID starting with a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7 not found: ID does not exist" containerID="a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7" Jul 06 19:30:38.970302 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:38.970211 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7"} err="failed to get container status \"a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7\": rpc error: code = NotFound desc = could not find container \"a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7\": container with ID starting with a5672a7d15997a602075a4d75c59e7ed76f476fbb314e27d4d1f0af3c1fc34b7 not found: ID does not exist" Jul 06 19:30:41.313206 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:41.313176 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-594f9969c-m64tn"] Jul 06 19:30:41.371237 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:41.371213 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-594f9969c-m64tn"] Jul 06 19:30:42.809557 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:42.809529 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" path="/var/lib/kubelet/pods/e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1/volumes" Jul 06 19:30:47.704384 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.704350 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g"] Jul 06 19:30:47.704743 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.704668 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" containerName="console" Jul 06 19:30:47.704743 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.704680 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" containerName="console" Jul 06 19:30:47.704743 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.704737 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e75270fc-c4d2-4cc4-9ae0-6ba80ea640c1" containerName="console" Jul 06 19:30:47.706780 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.706764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.710257 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.710237 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:30:47.710718 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.710702 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:30:47.711296 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.711280 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-759wd\"" Jul 06 19:30:47.728706 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.728682 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g"] Jul 06 19:30:47.791301 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.791274 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.791391 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.791307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.791391 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.791333 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp7bc\" (UniqueName: \"kubernetes.io/projected/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-kube-api-access-hp7bc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.892119 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.892097 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp7bc\" (UniqueName: \"kubernetes.io/projected/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-kube-api-access-hp7bc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.892223 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.892170 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.892223 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.892190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.892470 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.892455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.892525 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.892509 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:47.904591 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:47.904566 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp7bc\" (UniqueName: \"kubernetes.io/projected/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-kube-api-access-hp7bc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:48.015812 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:48.015764 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:30:48.144382 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:48.144353 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g"] Jul 06 19:30:48.147234 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:30:48.147207 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f59dcd2_47b8_4e9f_bac8_c344dfb9f0ea.slice/crio-029625aae2b507b593ef23faa79a459522cde96e42ad038d4e3942aed75ec568 WatchSource:0}: Error finding container 029625aae2b507b593ef23faa79a459522cde96e42ad038d4e3942aed75ec568: Status 404 returned error can't find the container with id 029625aae2b507b593ef23faa79a459522cde96e42ad038d4e3942aed75ec568 Jul 06 19:30:48.606648 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:48.606620 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:30:49.000955 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:49.000923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" event={"ID":"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea","Type":"ContainerStarted","Data":"029625aae2b507b593ef23faa79a459522cde96e42ad038d4e3942aed75ec568"} Jul 06 19:30:57.036210 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:57.036178 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerID="8b1a8fd72f98aaecada2959815d6c31cc337b9dd9fda3e03527e2088be1dd174" exitCode=0 Jul 06 19:30:57.036558 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:57.036267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" event={"ID":"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea","Type":"ContainerDied","Data":"8b1a8fd72f98aaecada2959815d6c31cc337b9dd9fda3e03527e2088be1dd174"} Jul 06 19:30:57.037113 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:57.037100 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:30:59.047161 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:59.047082 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerID="987c7dfffae2522f225c22a4da538f0cf624c9ccde0c2666f53156c4e772fce5" exitCode=0 Jul 06 19:30:59.047495 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:30:59.047182 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" event={"ID":"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea","Type":"ContainerDied","Data":"987c7dfffae2522f225c22a4da538f0cf624c9ccde0c2666f53156c4e772fce5"} Jul 06 19:31:08.087818 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:08.087781 2563 generic.go:356] "Generic (PLEG): container finished" podID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerID="84f01c2f87b0affb0ab5cecb93f455224dcd7fd1721a50c043f1908bc7e49366" exitCode=0 Jul 06 19:31:08.088196 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:08.087859 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" event={"ID":"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea","Type":"ContainerDied","Data":"84f01c2f87b0affb0ab5cecb93f455224dcd7fd1721a50c043f1908bc7e49366"} Jul 06 19:31:09.216270 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.216241 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:31:09.267917 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.267888 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-bundle\") pod \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " Jul 06 19:31:09.268026 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.267957 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp7bc\" (UniqueName: \"kubernetes.io/projected/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-kube-api-access-hp7bc\") pod \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " Jul 06 19:31:09.268026 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.268000 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-util\") pod \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\" (UID: \"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea\") " Jul 06 19:31:09.268547 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.268524 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-bundle" (OuterVolumeSpecName: "bundle") pod "0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" (UID: "0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:09.270254 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.270231 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-kube-api-access-hp7bc" (OuterVolumeSpecName: "kube-api-access-hp7bc") pod "0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" (UID: "0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea"). InnerVolumeSpecName "kube-api-access-hp7bc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:09.274711 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.274688 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-util" (OuterVolumeSpecName: "util") pod "0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" (UID: "0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:09.368979 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.368960 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp7bc\" (UniqueName: \"kubernetes.io/projected/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-kube-api-access-hp7bc\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:09.368979 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.368979 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-util\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:09.369090 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:09.368988 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:10.097227 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:10.097190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" event={"ID":"0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea","Type":"ContainerDied","Data":"029625aae2b507b593ef23faa79a459522cde96e42ad038d4e3942aed75ec568"} Jul 06 19:31:10.097227 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:10.097209 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404hr5g" Jul 06 19:31:10.097414 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:10.097241 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="029625aae2b507b593ef23faa79a459522cde96e42ad038d4e3942aed75ec568" Jul 06 19:31:16.531464 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.531431 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4"] Jul 06 19:31:16.532033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.531863 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerName="extract" Jul 06 19:31:16.532033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.531883 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerName="extract" Jul 06 19:31:16.532033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.531904 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerName="util" Jul 06 19:31:16.532033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.531913 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerName="util" Jul 06 19:31:16.532033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.531937 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerName="pull" Jul 06 19:31:16.532033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.531944 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerName="pull" Jul 06 19:31:16.532033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.532017 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59dcd2-47b8-4e9f-bac8-c344dfb9f0ea" containerName="extract" Jul 06 19:31:16.534170 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.534130 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:16.538216 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.538197 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:31:16.538325 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.538222 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mz64v\"" Jul 06 19:31:16.538377 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.538336 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 19:31:16.582477 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.582452 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4"] Jul 06 19:31:16.623733 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.623705 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mglhr\" (UniqueName: \"kubernetes.io/projected/01acc259-0589-48c4-9fed-d099dce4c1b7-kube-api-access-mglhr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mtlm4\" (UID: \"01acc259-0589-48c4-9fed-d099dce4c1b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:16.623897 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.623766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01acc259-0589-48c4-9fed-d099dce4c1b7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mtlm4\" (UID: \"01acc259-0589-48c4-9fed-d099dce4c1b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:16.724435 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.724398 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mglhr\" (UniqueName: \"kubernetes.io/projected/01acc259-0589-48c4-9fed-d099dce4c1b7-kube-api-access-mglhr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mtlm4\" (UID: \"01acc259-0589-48c4-9fed-d099dce4c1b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:16.724628 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.724463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01acc259-0589-48c4-9fed-d099dce4c1b7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mtlm4\" (UID: \"01acc259-0589-48c4-9fed-d099dce4c1b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:16.724852 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.724833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01acc259-0589-48c4-9fed-d099dce4c1b7-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mtlm4\" (UID: \"01acc259-0589-48c4-9fed-d099dce4c1b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:16.742922 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.742890 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mglhr\" (UniqueName: \"kubernetes.io/projected/01acc259-0589-48c4-9fed-d099dce4c1b7-kube-api-access-mglhr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mtlm4\" (UID: \"01acc259-0589-48c4-9fed-d099dce4c1b7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:16.842728 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:16.842645 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" Jul 06 19:31:17.065695 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:17.065663 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4"] Jul 06 19:31:17.066951 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:31:17.066928 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01acc259_0589_48c4_9fed_d099dce4c1b7.slice/crio-dfba26e95b21c5bc66f4c62852771e82d1d538be23edc9f6cd1c581e5cb6cca7 WatchSource:0}: Error finding container dfba26e95b21c5bc66f4c62852771e82d1d538be23edc9f6cd1c581e5cb6cca7: Status 404 returned error can't find the container with id dfba26e95b21c5bc66f4c62852771e82d1d538be23edc9f6cd1c581e5cb6cca7 Jul 06 19:31:17.127861 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:17.127826 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" event={"ID":"01acc259-0589-48c4-9fed-d099dce4c1b7","Type":"ContainerStarted","Data":"dfba26e95b21c5bc66f4c62852771e82d1d538be23edc9f6cd1c581e5cb6cca7"} Jul 06 19:31:19.139599 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:19.139564 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" event={"ID":"01acc259-0589-48c4-9fed-d099dce4c1b7","Type":"ContainerStarted","Data":"84119ff9167208a26aaea363667c2dd2ebbdef9259ad8f9d7142d11fc5a98345"} Jul 06 19:31:19.230043 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:19.229995 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mtlm4" podStartSLOduration=1.7343874540000002 podStartE2EDuration="3.22998038s" totalImagesPullingTime="1.495592926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:19.227220243 +0000 UTC m=+330.984389742" watchObservedRunningTime="2026-07-06 19:31:19.22998038 +0000 UTC m=+330.987149867" Jul 06 19:31:20.273272 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.273240 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c"] Jul 06 19:31:20.275753 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.275737 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.284564 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.284542 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:31:20.285238 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.285222 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-759wd\"" Jul 06 19:31:20.285341 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.285239 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:31:20.328759 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.328736 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c"] Jul 06 19:31:20.354992 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.354965 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.355170 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.355024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr44v\" (UniqueName: \"kubernetes.io/projected/b0c79505-6c8a-4bf4-8d11-20611fd65c05-kube-api-access-kr44v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.355170 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.355096 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.456444 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.456409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr44v\" (UniqueName: \"kubernetes.io/projected/b0c79505-6c8a-4bf4-8d11-20611fd65c05-kube-api-access-kr44v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.456646 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.456461 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.456646 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.456501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.456938 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.456914 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.456984 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.456928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.500846 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.500813 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr44v\" (UniqueName: \"kubernetes.io/projected/b0c79505-6c8a-4bf4-8d11-20611fd65c05-kube-api-access-kr44v\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.584477 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.584399 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:20.761426 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:20.761402 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c"] Jul 06 19:31:20.763355 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:31:20.763330 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c79505_6c8a_4bf4_8d11_20611fd65c05.slice/crio-080249e82c43452e29d945867a7c134b0ce1c2309cb8f38b187b92aaf9257f3a WatchSource:0}: Error finding container 080249e82c43452e29d945867a7c134b0ce1c2309cb8f38b187b92aaf9257f3a: Status 404 returned error can't find the container with id 080249e82c43452e29d945867a7c134b0ce1c2309cb8f38b187b92aaf9257f3a Jul 06 19:31:21.149069 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.149041 2563 generic.go:356] "Generic (PLEG): container finished" podID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerID="6d42af97a9da86c7b6fe7165212028fe6c9350e6f9b7586a0b9df1c69077ea6b" exitCode=0 Jul 06 19:31:21.149261 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.149119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" event={"ID":"b0c79505-6c8a-4bf4-8d11-20611fd65c05","Type":"ContainerDied","Data":"6d42af97a9da86c7b6fe7165212028fe6c9350e6f9b7586a0b9df1c69077ea6b"} Jul 06 19:31:21.149261 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.149190 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" event={"ID":"b0c79505-6c8a-4bf4-8d11-20611fd65c05","Type":"ContainerStarted","Data":"080249e82c43452e29d945867a7c134b0ce1c2309cb8f38b187b92aaf9257f3a"} Jul 06 19:31:21.245489 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.245454 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nz4r8"] Jul 06 19:31:21.247645 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.247624 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.252928 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.252906 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 19:31:21.253072 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.252945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 19:31:21.257232 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.257217 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ld52d\"" Jul 06 19:31:21.275589 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.275565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nz4r8"] Jul 06 19:31:21.364053 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.364025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9467\" (UniqueName: \"kubernetes.io/projected/dd147cad-8213-40a7-b49b-0af37f11356d-kube-api-access-g9467\") pod \"cert-manager-webhook-6486ffd997-nz4r8\" (UID: \"dd147cad-8213-40a7-b49b-0af37f11356d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.364232 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.364069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd147cad-8213-40a7-b49b-0af37f11356d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nz4r8\" (UID: \"dd147cad-8213-40a7-b49b-0af37f11356d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.469999 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.465117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9467\" (UniqueName: \"kubernetes.io/projected/dd147cad-8213-40a7-b49b-0af37f11356d-kube-api-access-g9467\") pod \"cert-manager-webhook-6486ffd997-nz4r8\" (UID: \"dd147cad-8213-40a7-b49b-0af37f11356d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.469999 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.465250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd147cad-8213-40a7-b49b-0af37f11356d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nz4r8\" (UID: \"dd147cad-8213-40a7-b49b-0af37f11356d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.480136 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.480110 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd147cad-8213-40a7-b49b-0af37f11356d-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nz4r8\" (UID: \"dd147cad-8213-40a7-b49b-0af37f11356d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.480809 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.480794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9467\" (UniqueName: \"kubernetes.io/projected/dd147cad-8213-40a7-b49b-0af37f11356d-kube-api-access-g9467\") pod \"cert-manager-webhook-6486ffd997-nz4r8\" (UID: \"dd147cad-8213-40a7-b49b-0af37f11356d\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.566411 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.566366 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:21.696545 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:21.696512 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nz4r8"] Jul 06 19:31:21.697479 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:31:21.697448 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd147cad_8213_40a7_b49b_0af37f11356d.slice/crio-0f83ec73fa75d8958b0336a598609e8fdd7a58e3f4961d06bb587a5225f13470 WatchSource:0}: Error finding container 0f83ec73fa75d8958b0336a598609e8fdd7a58e3f4961d06bb587a5225f13470: Status 404 returned error can't find the container with id 0f83ec73fa75d8958b0336a598609e8fdd7a58e3f4961d06bb587a5225f13470 Jul 06 19:31:22.155942 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:22.155902 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" event={"ID":"dd147cad-8213-40a7-b49b-0af37f11356d","Type":"ContainerStarted","Data":"0f83ec73fa75d8958b0336a598609e8fdd7a58e3f4961d06bb587a5225f13470"} Jul 06 19:31:24.169692 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:24.169659 2563 generic.go:356] "Generic (PLEG): container finished" podID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerID="674856d2a24756da0c73368144a2504afcb1c8f618d485ee68e679118900d77f" exitCode=0 Jul 06 19:31:24.170164 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:24.169767 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" event={"ID":"b0c79505-6c8a-4bf4-8d11-20611fd65c05","Type":"ContainerDied","Data":"674856d2a24756da0c73368144a2504afcb1c8f618d485ee68e679118900d77f"} Jul 06 19:31:25.176393 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:25.176361 2563 generic.go:356] "Generic (PLEG): container finished" podID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerID="bb5263869d88ad711fd8cd2fa0697a9f25097a337253bf7eef31ae7c92a5dd92" exitCode=0 Jul 06 19:31:25.176768 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:25.176447 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" event={"ID":"b0c79505-6c8a-4bf4-8d11-20611fd65c05","Type":"ContainerDied","Data":"bb5263869d88ad711fd8cd2fa0697a9f25097a337253bf7eef31ae7c92a5dd92"} Jul 06 19:31:25.177757 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:25.177737 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" event={"ID":"dd147cad-8213-40a7-b49b-0af37f11356d","Type":"ContainerStarted","Data":"923dadbc02720eb7651d09ef010dae1ed03cee23ec60a1e326dfa29aafac12f4"} Jul 06 19:31:25.177865 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:25.177851 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:25.216242 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:25.216202 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" podStartSLOduration=1.607594102 podStartE2EDuration="4.216183719s" totalImagesPullingTime="2.608589617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:25.215231914 +0000 UTC m=+336.972401406" watchObservedRunningTime="2026-07-06 19:31:25.216183719 +0000 UTC m=+336.973353207" Jul 06 19:31:26.305796 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.305775 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:26.406838 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.406813 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr44v\" (UniqueName: \"kubernetes.io/projected/b0c79505-6c8a-4bf4-8d11-20611fd65c05-kube-api-access-kr44v\") pod \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " Jul 06 19:31:26.406980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.406871 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-util\") pod \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " Jul 06 19:31:26.406980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.406938 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-bundle\") pod \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\" (UID: \"b0c79505-6c8a-4bf4-8d11-20611fd65c05\") " Jul 06 19:31:26.407347 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.407324 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-bundle" (OuterVolumeSpecName: "bundle") pod "b0c79505-6c8a-4bf4-8d11-20611fd65c05" (UID: "b0c79505-6c8a-4bf4-8d11-20611fd65c05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:26.408755 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.408731 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c79505-6c8a-4bf4-8d11-20611fd65c05-kube-api-access-kr44v" (OuterVolumeSpecName: "kube-api-access-kr44v") pod "b0c79505-6c8a-4bf4-8d11-20611fd65c05" (UID: "b0c79505-6c8a-4bf4-8d11-20611fd65c05"). InnerVolumeSpecName "kube-api-access-kr44v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:26.434289 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.434233 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-util" (OuterVolumeSpecName: "util") pod "b0c79505-6c8a-4bf4-8d11-20611fd65c05" (UID: "b0c79505-6c8a-4bf4-8d11-20611fd65c05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:26.508402 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.508379 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:26.508402 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.508399 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr44v\" (UniqueName: \"kubernetes.io/projected/b0c79505-6c8a-4bf4-8d11-20611fd65c05-kube-api-access-kr44v\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:26.508520 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:26.508410 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b0c79505-6c8a-4bf4-8d11-20611fd65c05-util\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:27.188113 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:27.188088 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" Jul 06 19:31:27.188113 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:27.188107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkwz5c" event={"ID":"b0c79505-6c8a-4bf4-8d11-20611fd65c05","Type":"ContainerDied","Data":"080249e82c43452e29d945867a7c134b0ce1c2309cb8f38b187b92aaf9257f3a"} Jul 06 19:31:27.188316 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:27.188161 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="080249e82c43452e29d945867a7c134b0ce1c2309cb8f38b187b92aaf9257f3a" Jul 06 19:31:31.184799 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:31.184768 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nz4r8" Jul 06 19:31:41.059450 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059369 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm"] Jul 06 19:31:41.059860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059700 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerName="pull" Jul 06 19:31:41.059860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059711 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerName="pull" Jul 06 19:31:41.059860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059717 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerName="extract" Jul 06 19:31:41.059860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059723 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerName="extract" Jul 06 19:31:41.059860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059739 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerName="util" Jul 06 19:31:41.059860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059744 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerName="util" Jul 06 19:31:41.059860 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.059793 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c79505-6c8a-4bf4-8d11-20611fd65c05" containerName="extract" Jul 06 19:31:41.064698 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.064679 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.071018 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.070996 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-759wd\"" Jul 06 19:31:41.071018 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.071007 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 19:31:41.071697 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.071679 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 19:31:41.101023 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.100998 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm"] Jul 06 19:31:41.127620 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.127593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.127716 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.127672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.127716 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.127694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbzf\" (UniqueName: \"kubernetes.io/projected/71c37011-3244-48b2-82e9-b32519a3cc66-kube-api-access-wzbzf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.228762 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.228732 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.228762 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.228765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbzf\" (UniqueName: \"kubernetes.io/projected/71c37011-3244-48b2-82e9-b32519a3cc66-kube-api-access-wzbzf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.228933 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.228790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.229115 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.229099 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.229173 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.229100 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.238829 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.238808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbzf\" (UniqueName: \"kubernetes.io/projected/71c37011-3244-48b2-82e9-b32519a3cc66-kube-api-access-wzbzf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.373897 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.373875 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:41.516446 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:41.516411 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm"] Jul 06 19:31:41.520081 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:31:41.520054 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c37011_3244_48b2_82e9_b32519a3cc66.slice/crio-a4cf522e07209e7391e87f9d83e84ac39f36202d70257beca990f5d03780ecfa WatchSource:0}: Error finding container a4cf522e07209e7391e87f9d83e84ac39f36202d70257beca990f5d03780ecfa: Status 404 returned error can't find the container with id a4cf522e07209e7391e87f9d83e84ac39f36202d70257beca990f5d03780ecfa Jul 06 19:31:42.256062 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:42.256031 2563 generic.go:356] "Generic (PLEG): container finished" podID="71c37011-3244-48b2-82e9-b32519a3cc66" containerID="de379f13124ddd80c1c5b708a60c047c51d277a235ea363ba264872e66bbe6a7" exitCode=0 Jul 06 19:31:42.256481 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:42.256117 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" event={"ID":"71c37011-3244-48b2-82e9-b32519a3cc66","Type":"ContainerDied","Data":"de379f13124ddd80c1c5b708a60c047c51d277a235ea363ba264872e66bbe6a7"} Jul 06 19:31:42.256481 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:42.256183 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" event={"ID":"71c37011-3244-48b2-82e9-b32519a3cc66","Type":"ContainerStarted","Data":"a4cf522e07209e7391e87f9d83e84ac39f36202d70257beca990f5d03780ecfa"} Jul 06 19:31:43.262840 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:43.262753 2563 generic.go:356] "Generic (PLEG): container finished" podID="71c37011-3244-48b2-82e9-b32519a3cc66" containerID="f0699173c57a7ddc2ca51d7092140f08b325813deddf33edaf4ce8c5a3b8f0fa" exitCode=0 Jul 06 19:31:43.263269 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:43.262842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" event={"ID":"71c37011-3244-48b2-82e9-b32519a3cc66","Type":"ContainerDied","Data":"f0699173c57a7ddc2ca51d7092140f08b325813deddf33edaf4ce8c5a3b8f0fa"} Jul 06 19:31:44.270084 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:44.270050 2563 generic.go:356] "Generic (PLEG): container finished" podID="71c37011-3244-48b2-82e9-b32519a3cc66" containerID="563dabd8f1930bfa39c7b3a11ab82c9b356d5fb85221aab9c40520af3bd9790a" exitCode=0 Jul 06 19:31:44.270477 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:44.270128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" event={"ID":"71c37011-3244-48b2-82e9-b32519a3cc66","Type":"ContainerDied","Data":"563dabd8f1930bfa39c7b3a11ab82c9b356d5fb85221aab9c40520af3bd9790a"} Jul 06 19:31:45.398459 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.398437 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:45.465383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.465361 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-bundle\") pod \"71c37011-3244-48b2-82e9-b32519a3cc66\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " Jul 06 19:31:45.465510 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.465397 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-util\") pod \"71c37011-3244-48b2-82e9-b32519a3cc66\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " Jul 06 19:31:45.465510 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.465452 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzbzf\" (UniqueName: \"kubernetes.io/projected/71c37011-3244-48b2-82e9-b32519a3cc66-kube-api-access-wzbzf\") pod \"71c37011-3244-48b2-82e9-b32519a3cc66\" (UID: \"71c37011-3244-48b2-82e9-b32519a3cc66\") " Jul 06 19:31:45.465975 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.465950 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-bundle" (OuterVolumeSpecName: "bundle") pod "71c37011-3244-48b2-82e9-b32519a3cc66" (UID: "71c37011-3244-48b2-82e9-b32519a3cc66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:45.467431 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.467409 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c37011-3244-48b2-82e9-b32519a3cc66-kube-api-access-wzbzf" (OuterVolumeSpecName: "kube-api-access-wzbzf") pod "71c37011-3244-48b2-82e9-b32519a3cc66" (UID: "71c37011-3244-48b2-82e9-b32519a3cc66"). InnerVolumeSpecName "kube-api-access-wzbzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:31:45.474006 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.473982 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-util" (OuterVolumeSpecName: "util") pod "71c37011-3244-48b2-82e9-b32519a3cc66" (UID: "71c37011-3244-48b2-82e9-b32519a3cc66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:31:45.566475 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.566403 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:45.566475 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.566438 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71c37011-3244-48b2-82e9-b32519a3cc66-util\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:45.566475 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:45.566447 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzbzf\" (UniqueName: \"kubernetes.io/projected/71c37011-3244-48b2-82e9-b32519a3cc66-kube-api-access-wzbzf\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:31:46.279927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:46.279899 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" Jul 06 19:31:46.280089 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:46.279901 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvddsm" event={"ID":"71c37011-3244-48b2-82e9-b32519a3cc66","Type":"ContainerDied","Data":"a4cf522e07209e7391e87f9d83e84ac39f36202d70257beca990f5d03780ecfa"} Jul 06 19:31:46.280089 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:46.280021 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4cf522e07209e7391e87f9d83e84ac39f36202d70257beca990f5d03780ecfa" Jul 06 19:31:55.118843 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.118808 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p"] Jul 06 19:31:55.119241 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.119121 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c37011-3244-48b2-82e9-b32519a3cc66" containerName="util" Jul 06 19:31:55.119241 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.119133 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c37011-3244-48b2-82e9-b32519a3cc66" containerName="util" Jul 06 19:31:55.119241 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.119140 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c37011-3244-48b2-82e9-b32519a3cc66" containerName="pull" Jul 06 19:31:55.119241 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.119169 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c37011-3244-48b2-82e9-b32519a3cc66" containerName="pull" Jul 06 19:31:55.119241 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.119187 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c37011-3244-48b2-82e9-b32519a3cc66" containerName="extract" Jul 06 19:31:55.119241 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.119193 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c37011-3244-48b2-82e9-b32519a3cc66" containerName="extract" Jul 06 19:31:55.119414 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.119245 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c37011-3244-48b2-82e9-b32519a3cc66" containerName="extract" Jul 06 19:31:55.122426 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.122410 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.128273 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.128241 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gfdrn\"" Jul 06 19:31:55.128273 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.128254 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:31:55.128942 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.128925 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:31:55.129187 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.129131 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:31:55.145106 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.145085 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:31:55.245991 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.245958 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f39faf9b-dfa4-465c-8a09-c8366dbac250-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.246185 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.246036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f39faf9b-dfa4-465c-8a09-c8366dbac250-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.246185 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.246062 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cw6m\" (UniqueName: \"kubernetes.io/projected/f39faf9b-dfa4-465c-8a09-c8366dbac250-kube-api-access-9cw6m\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.246185 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.246107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f39faf9b-dfa4-465c-8a09-c8366dbac250-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.246185 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.246131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f39faf9b-dfa4-465c-8a09-c8366dbac250-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.346830 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.346801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f39faf9b-dfa4-465c-8a09-c8366dbac250-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.346990 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.346862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f39faf9b-dfa4-465c-8a09-c8366dbac250-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.346990 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.346883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cw6m\" (UniqueName: \"kubernetes.io/projected/f39faf9b-dfa4-465c-8a09-c8366dbac250-kube-api-access-9cw6m\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.346990 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.346916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f39faf9b-dfa4-465c-8a09-c8366dbac250-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.346990 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.346937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f39faf9b-dfa4-465c-8a09-c8366dbac250-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.347382 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.347357 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f39faf9b-dfa4-465c-8a09-c8366dbac250-manifests\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.349194 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.349169 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f39faf9b-dfa4-465c-8a09-c8366dbac250-tmp\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.349278 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.349235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f39faf9b-dfa4-465c-8a09-c8366dbac250-webhook-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.349326 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.349300 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f39faf9b-dfa4-465c-8a09-c8366dbac250-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.438254 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.438193 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cw6m\" (UniqueName: \"kubernetes.io/projected/f39faf9b-dfa4-465c-8a09-c8366dbac250-kube-api-access-9cw6m\") pod \"opendatahub-operator-controller-manager-79c9ddb849-czm5p\" (UID: \"f39faf9b-dfa4-465c-8a09-c8366dbac250\") " pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.682279 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.682245 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p"] Jul 06 19:31:55.731800 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.731733 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:31:55.922278 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:55.922250 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p"] Jul 06 19:31:55.923048 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:31:55.923029 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39faf9b_dfa4_465c_8a09_c8366dbac250.slice/crio-3772e5716ef6193964585c870747c306b0937ae757e7afe8b4192be69552991d WatchSource:0}: Error finding container 3772e5716ef6193964585c870747c306b0937ae757e7afe8b4192be69552991d: Status 404 returned error can't find the container with id 3772e5716ef6193964585c870747c306b0937ae757e7afe8b4192be69552991d Jul 06 19:31:56.328423 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.328386 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" event={"ID":"f39faf9b-dfa4-465c-8a09-c8366dbac250","Type":"ContainerStarted","Data":"3772e5716ef6193964585c870747c306b0937ae757e7afe8b4192be69552991d"} Jul 06 19:31:56.620262 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.620229 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb"] Jul 06 19:31:56.623531 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.623508 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.630559 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.630406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 19:31:56.630559 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.630476 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:31:56.654226 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.654205 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:31:56.702041 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.702013 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-skzbv\"" Jul 06 19:31:56.707351 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.707333 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 19:31:56.710367 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.710355 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 19:31:56.731120 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.731097 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb"] Jul 06 19:31:56.759701 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.759675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clfkt\" (UniqueName: \"kubernetes.io/projected/207527af-32a5-414c-9b81-fd61746ac4a6-kube-api-access-clfkt\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.759840 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.759728 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/207527af-32a5-414c-9b81-fd61746ac4a6-cert\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.759840 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.759751 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/207527af-32a5-414c-9b81-fd61746ac4a6-manager-config\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.759969 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.759910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/207527af-32a5-414c-9b81-fd61746ac4a6-metrics-cert\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.860618 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.860586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clfkt\" (UniqueName: \"kubernetes.io/projected/207527af-32a5-414c-9b81-fd61746ac4a6-kube-api-access-clfkt\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.860778 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.860667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/207527af-32a5-414c-9b81-fd61746ac4a6-cert\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.860778 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.860709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/207527af-32a5-414c-9b81-fd61746ac4a6-manager-config\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.860778 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.860769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/207527af-32a5-414c-9b81-fd61746ac4a6-metrics-cert\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.861408 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.861384 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/207527af-32a5-414c-9b81-fd61746ac4a6-manager-config\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.863033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.863008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/207527af-32a5-414c-9b81-fd61746ac4a6-cert\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.863033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.863029 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/207527af-32a5-414c-9b81-fd61746ac4a6-metrics-cert\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.874632 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.874576 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clfkt\" (UniqueName: \"kubernetes.io/projected/207527af-32a5-414c-9b81-fd61746ac4a6-kube-api-access-clfkt\") pod \"lws-controller-manager-5c85d89ddf-g42qb\" (UID: \"207527af-32a5-414c-9b81-fd61746ac4a6\") " pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:56.934736 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:56.934703 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:31:57.091587 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:57.091525 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb"] Jul 06 19:31:57.094426 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:31:57.094393 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207527af_32a5_414c_9b81_fd61746ac4a6.slice/crio-e4c1eef690ebf6906345d41dff2cb6f5e5d84ee8cc7bebbbd82431f0a2627c6f WatchSource:0}: Error finding container e4c1eef690ebf6906345d41dff2cb6f5e5d84ee8cc7bebbbd82431f0a2627c6f: Status 404 returned error can't find the container with id e4c1eef690ebf6906345d41dff2cb6f5e5d84ee8cc7bebbbd82431f0a2627c6f Jul 06 19:31:57.335496 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:31:57.335413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" event={"ID":"207527af-32a5-414c-9b81-fd61746ac4a6","Type":"ContainerStarted","Data":"e4c1eef690ebf6906345d41dff2cb6f5e5d84ee8cc7bebbbd82431f0a2627c6f"} Jul 06 19:32:00.352157 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:00.352118 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" event={"ID":"f39faf9b-dfa4-465c-8a09-c8366dbac250","Type":"ContainerStarted","Data":"af403d6ebda871486ca6eb28358a060230d24705558e11294737a2bf1efcbfbe"} Jul 06 19:32:00.353547 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:00.353526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" event={"ID":"207527af-32a5-414c-9b81-fd61746ac4a6","Type":"ContainerStarted","Data":"8547c8bd1b4d41d9016a4e75771e077e81547af9b7584e9bc71214f215bea91c"} Jul 06 19:32:00.353668 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:00.353654 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:32:00.398946 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:00.398898 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" podStartSLOduration=2.105019019 podStartE2EDuration="4.398882582s" totalImagesPullingTime="2.293863563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:00.396788183 +0000 UTC m=+372.153957671" watchObservedRunningTime="2026-07-06 19:32:00.398882582 +0000 UTC m=+372.156052070" Jul 06 19:32:01.360065 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:01.360032 2563 generic.go:356] "Generic (PLEG): container finished" podID="f39faf9b-dfa4-465c-8a09-c8366dbac250" containerID="af403d6ebda871486ca6eb28358a060230d24705558e11294737a2bf1efcbfbe" exitCode=0 Jul 06 19:32:01.360502 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:01.360102 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" event={"ID":"f39faf9b-dfa4-465c-8a09-c8366dbac250","Type":"ContainerDied","Data":"af403d6ebda871486ca6eb28358a060230d24705558e11294737a2bf1efcbfbe"} Jul 06 19:32:02.369526 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:02.369487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" event={"ID":"f39faf9b-dfa4-465c-8a09-c8366dbac250","Type":"ContainerStarted","Data":"575c58fb02baaf2d8bdc19f10dfb7c0f1d1e57eff49dfb19210c29bb27c21c82"} Jul 06 19:32:02.369878 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:02.369609 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:32:02.402100 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:02.402041 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" podStartSLOduration=2.45633911 podStartE2EDuration="7.402024584s" totalImagesPullingTime="3.795141896s" totalInitContainerRuntime="1.150543578s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:02.399325377 +0000 UTC m=+374.156494866" watchObservedRunningTime="2026-07-06 19:32:02.402024584 +0000 UTC m=+374.159194072" Jul 06 19:32:11.362840 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:11.362802 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:32:13.376858 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:13.376832 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79c9ddb849-czm5p" Jul 06 19:32:17.441345 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.441309 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx"] Jul 06 19:32:17.447477 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.447452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.451837 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.451817 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:32:17.451966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.451822 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 19:32:17.452052 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.452036 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nfq7k\"" Jul 06 19:32:17.465583 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.465555 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx"] Jul 06 19:32:17.537737 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.537704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwxqj\" (UniqueName: \"kubernetes.io/projected/88261861-6a97-4346-9823-ef81b3f39aac-kube-api-access-fwxqj\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.537900 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.537759 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88261861-6a97-4346-9823-ef81b3f39aac-tls-certs\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.537900 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.537859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88261861-6a97-4346-9823-ef81b3f39aac-tmp\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.638361 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.638322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88261861-6a97-4346-9823-ef81b3f39aac-tls-certs\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.638543 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.638404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88261861-6a97-4346-9823-ef81b3f39aac-tmp\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.638543 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.638506 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwxqj\" (UniqueName: \"kubernetes.io/projected/88261861-6a97-4346-9823-ef81b3f39aac-kube-api-access-fwxqj\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.640639 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.640609 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88261861-6a97-4346-9823-ef81b3f39aac-tmp\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.640988 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.640964 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88261861-6a97-4346-9823-ef81b3f39aac-tls-certs\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.659624 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.659597 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwxqj\" (UniqueName: \"kubernetes.io/projected/88261861-6a97-4346-9823-ef81b3f39aac-kube-api-access-fwxqj\") pod \"kube-auth-proxy-68c9f86fd7-x6dkx\" (UID: \"88261861-6a97-4346-9823-ef81b3f39aac\") " pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.757446 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.757376 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" Jul 06 19:32:17.919176 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:17.919131 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx"] Jul 06 19:32:17.922018 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:32:17.921988 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88261861_6a97_4346_9823_ef81b3f39aac.slice/crio-d1b7edab424062c84450bdb911aee6500745af597fb845506d43cf33157c7d03 WatchSource:0}: Error finding container d1b7edab424062c84450bdb911aee6500745af597fb845506d43cf33157c7d03: Status 404 returned error can't find the container with id d1b7edab424062c84450bdb911aee6500745af597fb845506d43cf33157c7d03 Jul 06 19:32:18.443333 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:18.443290 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" event={"ID":"88261861-6a97-4346-9823-ef81b3f39aac","Type":"ContainerStarted","Data":"d1b7edab424062c84450bdb911aee6500745af597fb845506d43cf33157c7d03"} Jul 06 19:32:21.457507 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:21.457481 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" event={"ID":"88261861-6a97-4346-9823-ef81b3f39aac","Type":"ContainerStarted","Data":"1351c84a0ae1eb07ee3974b0404342fe74be3149516f5cc2c5102a6da6d07f2e"} Jul 06 19:32:21.507404 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:32:21.507362 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-68c9f86fd7-x6dkx" podStartSLOduration=1.042684812 podStartE2EDuration="4.507347171s" totalImagesPullingTime="3.464662359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:32:21.507238675 +0000 UTC m=+393.264408163" watchObservedRunningTime="2026-07-06 19:32:21.507347171 +0000 UTC m=+393.264516659" Jul 06 19:33:32.679586 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.679550 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz"] Jul 06 19:33:32.683036 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.683017 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.685391 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.685339 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:33:32.685391 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.685378 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:33:32.685580 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.685559 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qbkj7\"" Jul 06 19:33:32.691806 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.691786 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz"] Jul 06 19:33:32.766694 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.766665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.766874 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.766746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.766874 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.766786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpwdf\" (UniqueName: \"kubernetes.io/projected/9183e870-af6e-42fc-b21e-a3e16f5ff7df-kube-api-access-vpwdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.867999 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.867964 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.868211 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.868031 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.868211 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.868069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpwdf\" (UniqueName: \"kubernetes.io/projected/9183e870-af6e-42fc-b21e-a3e16f5ff7df-kube-api-access-vpwdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.868433 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.868410 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.868509 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.868407 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.877485 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.877453 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpwdf\" (UniqueName: \"kubernetes.io/projected/9183e870-af6e-42fc-b21e-a3e16f5ff7df-kube-api-access-vpwdf\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:32.992497 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:32.992418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:33.126466 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.126440 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz"] Jul 06 19:33:33.128882 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:33:33.128854 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9183e870_af6e_42fc_b21e_a3e16f5ff7df.slice/crio-b00183b600f8101b7e20b6e5dd9e130e4eecde65e149668c5acd7315b54a9699 WatchSource:0}: Error finding container b00183b600f8101b7e20b6e5dd9e130e4eecde65e149668c5acd7315b54a9699: Status 404 returned error can't find the container with id b00183b600f8101b7e20b6e5dd9e130e4eecde65e149668c5acd7315b54a9699 Jul 06 19:33:33.281159 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.281080 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw"] Jul 06 19:33:33.284659 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.284644 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.304294 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.304272 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw"] Jul 06 19:33:33.371670 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.371635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkqbz\" (UniqueName: \"kubernetes.io/projected/010a9b62-cd05-44ec-b293-3443cf39e135-kube-api-access-rkqbz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.371832 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.371691 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.371832 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.371754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.472420 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.472383 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkqbz\" (UniqueName: \"kubernetes.io/projected/010a9b62-cd05-44ec-b293-3443cf39e135-kube-api-access-rkqbz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.472603 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.472435 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.472603 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.472480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.472843 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.472826 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.472878 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.472859 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.482477 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.482455 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkqbz\" (UniqueName: \"kubernetes.io/projected/010a9b62-cd05-44ec-b293-3443cf39e135-kube-api-access-rkqbz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.592958 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.592874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:33.681412 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.681381 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt"] Jul 06 19:33:33.685192 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.685170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.719497 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.719461 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt"] Jul 06 19:33:33.738828 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.738596 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw"] Jul 06 19:33:33.740901 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:33:33.740873 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010a9b62_cd05_44ec_b293_3443cf39e135.slice/crio-89fddd91df0174fe251f619ab770c7bc8be11fb0a9ce3953b4bbf42d85e99ca1 WatchSource:0}: Error finding container 89fddd91df0174fe251f619ab770c7bc8be11fb0a9ce3953b4bbf42d85e99ca1: Status 404 returned error can't find the container with id 89fddd91df0174fe251f619ab770c7bc8be11fb0a9ce3953b4bbf42d85e99ca1 Jul 06 19:33:33.774072 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.774046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mv66\" (UniqueName: \"kubernetes.io/projected/43a96073-5dd1-426e-9aaa-bac3814e2ff9-kube-api-access-4mv66\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.774202 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.774103 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.774202 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.774129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.790782 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.790752 2563 generic.go:356] "Generic (PLEG): container finished" podID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerID="32e98dd203752d44a3b8924965f4b934218fe413a4b7c79cc370bbe7df854e02" exitCode=0 Jul 06 19:33:33.790904 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.790835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" event={"ID":"9183e870-af6e-42fc-b21e-a3e16f5ff7df","Type":"ContainerDied","Data":"32e98dd203752d44a3b8924965f4b934218fe413a4b7c79cc370bbe7df854e02"} Jul 06 19:33:33.790971 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.790921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" event={"ID":"9183e870-af6e-42fc-b21e-a3e16f5ff7df","Type":"ContainerStarted","Data":"b00183b600f8101b7e20b6e5dd9e130e4eecde65e149668c5acd7315b54a9699"} Jul 06 19:33:33.792331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.792138 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" event={"ID":"010a9b62-cd05-44ec-b293-3443cf39e135","Type":"ContainerStarted","Data":"89fddd91df0174fe251f619ab770c7bc8be11fb0a9ce3953b4bbf42d85e99ca1"} Jul 06 19:33:33.875715 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.875690 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mv66\" (UniqueName: \"kubernetes.io/projected/43a96073-5dd1-426e-9aaa-bac3814e2ff9-kube-api-access-4mv66\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.875838 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.875739 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.875838 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.875781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.876136 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.876114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.876136 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.876129 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.885055 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.885036 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mv66\" (UniqueName: \"kubernetes.io/projected/43a96073-5dd1-426e-9aaa-bac3814e2ff9-kube-api-access-4mv66\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:33.994826 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:33.994797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:34.089357 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.089323 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9"] Jul 06 19:33:34.094193 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.094166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.107734 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.107706 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9"] Jul 06 19:33:34.140119 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.140096 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt"] Jul 06 19:33:34.142329 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:33:34.142300 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a96073_5dd1_426e_9aaa_bac3814e2ff9.slice/crio-426981df717475966ccc4b129ac020ab30cd9e6c7e621a6f876ff77c33c6c48c WatchSource:0}: Error finding container 426981df717475966ccc4b129ac020ab30cd9e6c7e621a6f876ff77c33c6c48c: Status 404 returned error can't find the container with id 426981df717475966ccc4b129ac020ab30cd9e6c7e621a6f876ff77c33c6c48c Jul 06 19:33:34.178484 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.178456 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.178577 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.178510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.178639 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.178588 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zv99\" (UniqueName: \"kubernetes.io/projected/b87fd570-9f27-4cca-9d39-3c634a7755fa-kube-api-access-4zv99\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.279621 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.279586 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.279752 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.279643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.279752 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.279706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zv99\" (UniqueName: \"kubernetes.io/projected/b87fd570-9f27-4cca-9d39-3c634a7755fa-kube-api-access-4zv99\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.279966 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.279947 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.280001 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.279985 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.289279 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.289256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zv99\" (UniqueName: \"kubernetes.io/projected/b87fd570-9f27-4cca-9d39-3c634a7755fa-kube-api-access-4zv99\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.406464 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.406385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:34.540511 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.540487 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9"] Jul 06 19:33:34.593916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:33:34.593883 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87fd570_9f27_4cca_9d39_3c634a7755fa.slice/crio-6e6037231d099742cc0cc02517bc3532925b7180ee7dfe85af708a300e433f21 WatchSource:0}: Error finding container 6e6037231d099742cc0cc02517bc3532925b7180ee7dfe85af708a300e433f21: Status 404 returned error can't find the container with id 6e6037231d099742cc0cc02517bc3532925b7180ee7dfe85af708a300e433f21 Jul 06 19:33:34.797914 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.797879 2563 generic.go:356] "Generic (PLEG): container finished" podID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerID="a76be60886dcc25bdf04f069daa1dd1febba9296fae8d5b613437f174d6573cb" exitCode=0 Jul 06 19:33:34.798344 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.797924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" event={"ID":"43a96073-5dd1-426e-9aaa-bac3814e2ff9","Type":"ContainerDied","Data":"a76be60886dcc25bdf04f069daa1dd1febba9296fae8d5b613437f174d6573cb"} Jul 06 19:33:34.798344 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.797975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" event={"ID":"43a96073-5dd1-426e-9aaa-bac3814e2ff9","Type":"ContainerStarted","Data":"426981df717475966ccc4b129ac020ab30cd9e6c7e621a6f876ff77c33c6c48c"} Jul 06 19:33:34.799596 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.799574 2563 generic.go:356] "Generic (PLEG): container finished" podID="010a9b62-cd05-44ec-b293-3443cf39e135" containerID="dd84f2bf55920feea929740214f7a6c4bc71962e7bbaf380105591c857b23f5c" exitCode=0 Jul 06 19:33:34.799679 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.799656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" event={"ID":"010a9b62-cd05-44ec-b293-3443cf39e135","Type":"ContainerDied","Data":"dd84f2bf55920feea929740214f7a6c4bc71962e7bbaf380105591c857b23f5c"} Jul 06 19:33:34.801599 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.801576 2563 generic.go:356] "Generic (PLEG): container finished" podID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerID="09b4f94b6ab1f1d28958ec746b7121a4d15a1f427b85177e8105710c36e823b0" exitCode=0 Jul 06 19:33:34.801707 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.801623 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" event={"ID":"9183e870-af6e-42fc-b21e-a3e16f5ff7df","Type":"ContainerDied","Data":"09b4f94b6ab1f1d28958ec746b7121a4d15a1f427b85177e8105710c36e823b0"} Jul 06 19:33:34.803124 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.803102 2563 generic.go:356] "Generic (PLEG): container finished" podID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerID="c45cd25da8a8f92773be54d9e76f5f97961ec9296ac8a63cab410fab8a3ef435" exitCode=0 Jul 06 19:33:34.803225 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.803158 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" event={"ID":"b87fd570-9f27-4cca-9d39-3c634a7755fa","Type":"ContainerDied","Data":"c45cd25da8a8f92773be54d9e76f5f97961ec9296ac8a63cab410fab8a3ef435"} Jul 06 19:33:34.803225 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:34.803212 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" event={"ID":"b87fd570-9f27-4cca-9d39-3c634a7755fa","Type":"ContainerStarted","Data":"6e6037231d099742cc0cc02517bc3532925b7180ee7dfe85af708a300e433f21"} Jul 06 19:33:35.809769 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:35.809744 2563 generic.go:356] "Generic (PLEG): container finished" podID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerID="c6c7d089253ec68586a028ce39252ae1095cd48c559445920d62d1f0c9fa5e95" exitCode=0 Jul 06 19:33:35.810086 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:35.809850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" event={"ID":"9183e870-af6e-42fc-b21e-a3e16f5ff7df","Type":"ContainerDied","Data":"c6c7d089253ec68586a028ce39252ae1095cd48c559445920d62d1f0c9fa5e95"} Jul 06 19:33:35.811310 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:35.811289 2563 generic.go:356] "Generic (PLEG): container finished" podID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerID="e27e8973b0be723d8df8e4327909c12aff34b0ec0d08c7309911056150bf6738" exitCode=0 Jul 06 19:33:35.811398 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:35.811352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" event={"ID":"43a96073-5dd1-426e-9aaa-bac3814e2ff9","Type":"ContainerDied","Data":"e27e8973b0be723d8df8e4327909c12aff34b0ec0d08c7309911056150bf6738"} Jul 06 19:33:36.817651 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:36.817620 2563 generic.go:356] "Generic (PLEG): container finished" podID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerID="216e5208f9a85bd8b160d467d8c2b40e7ccdc0980336c9e9d467067d94c02c7e" exitCode=0 Jul 06 19:33:36.818092 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:36.817712 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" event={"ID":"b87fd570-9f27-4cca-9d39-3c634a7755fa","Type":"ContainerDied","Data":"216e5208f9a85bd8b160d467d8c2b40e7ccdc0980336c9e9d467067d94c02c7e"} Jul 06 19:33:36.820011 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:36.819988 2563 generic.go:356] "Generic (PLEG): container finished" podID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerID="95f4e519a4f3d103b463bb10d241dbb1ce62504c19a2adf01816afb2477b9bca" exitCode=0 Jul 06 19:33:36.820107 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:36.820066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" event={"ID":"43a96073-5dd1-426e-9aaa-bac3814e2ff9","Type":"ContainerDied","Data":"95f4e519a4f3d103b463bb10d241dbb1ce62504c19a2adf01816afb2477b9bca"} Jul 06 19:33:36.821917 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:36.821895 2563 generic.go:356] "Generic (PLEG): container finished" podID="010a9b62-cd05-44ec-b293-3443cf39e135" containerID="1e236bd5aa042234923230aa38c5896bef79906db525420a04aca07a07d8d026" exitCode=0 Jul 06 19:33:36.822008 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:36.821970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" event={"ID":"010a9b62-cd05-44ec-b293-3443cf39e135","Type":"ContainerDied","Data":"1e236bd5aa042234923230aa38c5896bef79906db525420a04aca07a07d8d026"} Jul 06 19:33:36.959883 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:36.959856 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:37.104961 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.104931 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-util\") pod \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " Jul 06 19:33:37.105079 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.105013 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-bundle\") pod \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " Jul 06 19:33:37.105079 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.105065 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpwdf\" (UniqueName: \"kubernetes.io/projected/9183e870-af6e-42fc-b21e-a3e16f5ff7df-kube-api-access-vpwdf\") pod \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\" (UID: \"9183e870-af6e-42fc-b21e-a3e16f5ff7df\") " Jul 06 19:33:37.105585 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.105557 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-bundle" (OuterVolumeSpecName: "bundle") pod "9183e870-af6e-42fc-b21e-a3e16f5ff7df" (UID: "9183e870-af6e-42fc-b21e-a3e16f5ff7df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:37.107199 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.107168 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9183e870-af6e-42fc-b21e-a3e16f5ff7df-kube-api-access-vpwdf" (OuterVolumeSpecName: "kube-api-access-vpwdf") pod "9183e870-af6e-42fc-b21e-a3e16f5ff7df" (UID: "9183e870-af6e-42fc-b21e-a3e16f5ff7df"). InnerVolumeSpecName "kube-api-access-vpwdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:37.109684 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.109667 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-util" (OuterVolumeSpecName: "util") pod "9183e870-af6e-42fc-b21e-a3e16f5ff7df" (UID: "9183e870-af6e-42fc-b21e-a3e16f5ff7df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:37.206048 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.206024 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpwdf\" (UniqueName: \"kubernetes.io/projected/9183e870-af6e-42fc-b21e-a3e16f5ff7df-kube-api-access-vpwdf\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.206048 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.206047 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-util\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.206210 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.206056 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9183e870-af6e-42fc-b21e-a3e16f5ff7df-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:37.828915 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.828882 2563 generic.go:356] "Generic (PLEG): container finished" podID="010a9b62-cd05-44ec-b293-3443cf39e135" containerID="9803ebf69c8d9a92f3e00a4d5ecea5ce862f714010fc10f1b188daae3364fcb1" exitCode=0 Jul 06 19:33:37.829359 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.828974 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" event={"ID":"010a9b62-cd05-44ec-b293-3443cf39e135","Type":"ContainerDied","Data":"9803ebf69c8d9a92f3e00a4d5ecea5ce862f714010fc10f1b188daae3364fcb1"} Jul 06 19:33:37.830658 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.830640 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" Jul 06 19:33:37.830778 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.830642 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz" event={"ID":"9183e870-af6e-42fc-b21e-a3e16f5ff7df","Type":"ContainerDied","Data":"b00183b600f8101b7e20b6e5dd9e130e4eecde65e149668c5acd7315b54a9699"} Jul 06 19:33:37.830778 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.830756 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b00183b600f8101b7e20b6e5dd9e130e4eecde65e149668c5acd7315b54a9699" Jul 06 19:33:37.832716 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.832688 2563 generic.go:356] "Generic (PLEG): container finished" podID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerID="c63c9b09267905f24e36515932cd2dd627202cbd3b477266260b252f1b7df74b" exitCode=0 Jul 06 19:33:37.832850 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.832761 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" event={"ID":"b87fd570-9f27-4cca-9d39-3c634a7755fa","Type":"ContainerDied","Data":"c63c9b09267905f24e36515932cd2dd627202cbd3b477266260b252f1b7df74b"} Jul 06 19:33:37.961336 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:37.961312 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:38.115217 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.115105 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-bundle\") pod \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " Jul 06 19:33:38.115217 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.115199 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-util\") pod \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " Jul 06 19:33:38.115419 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.115257 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mv66\" (UniqueName: \"kubernetes.io/projected/43a96073-5dd1-426e-9aaa-bac3814e2ff9-kube-api-access-4mv66\") pod \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\" (UID: \"43a96073-5dd1-426e-9aaa-bac3814e2ff9\") " Jul 06 19:33:38.115617 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.115593 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-bundle" (OuterVolumeSpecName: "bundle") pod "43a96073-5dd1-426e-9aaa-bac3814e2ff9" (UID: "43a96073-5dd1-426e-9aaa-bac3814e2ff9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:38.117297 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.117269 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a96073-5dd1-426e-9aaa-bac3814e2ff9-kube-api-access-4mv66" (OuterVolumeSpecName: "kube-api-access-4mv66") pod "43a96073-5dd1-426e-9aaa-bac3814e2ff9" (UID: "43a96073-5dd1-426e-9aaa-bac3814e2ff9"). InnerVolumeSpecName "kube-api-access-4mv66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:38.120535 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.120509 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-util" (OuterVolumeSpecName: "util") pod "43a96073-5dd1-426e-9aaa-bac3814e2ff9" (UID: "43a96073-5dd1-426e-9aaa-bac3814e2ff9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:38.216794 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.216764 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:38.216794 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.216787 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a96073-5dd1-426e-9aaa-bac3814e2ff9-util\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:38.216794 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.216798 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mv66\" (UniqueName: \"kubernetes.io/projected/43a96073-5dd1-426e-9aaa-bac3814e2ff9-kube-api-access-4mv66\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:38.839534 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.839504 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" Jul 06 19:33:38.839534 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.839526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt" event={"ID":"43a96073-5dd1-426e-9aaa-bac3814e2ff9","Type":"ContainerDied","Data":"426981df717475966ccc4b129ac020ab30cd9e6c7e621a6f876ff77c33c6c48c"} Jul 06 19:33:38.839905 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.839570 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="426981df717475966ccc4b129ac020ab30cd9e6c7e621a6f876ff77c33c6c48c" Jul 06 19:33:38.999737 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:38.999715 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:39.006482 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.006228 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:39.123873 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.123850 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-util\") pod \"010a9b62-cd05-44ec-b293-3443cf39e135\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " Jul 06 19:33:39.124016 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.123896 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-util\") pod \"b87fd570-9f27-4cca-9d39-3c634a7755fa\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " Jul 06 19:33:39.124016 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.123934 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-bundle\") pod \"010a9b62-cd05-44ec-b293-3443cf39e135\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " Jul 06 19:33:39.124016 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.123961 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zv99\" (UniqueName: \"kubernetes.io/projected/b87fd570-9f27-4cca-9d39-3c634a7755fa-kube-api-access-4zv99\") pod \"b87fd570-9f27-4cca-9d39-3c634a7755fa\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " Jul 06 19:33:39.124016 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.124014 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-bundle\") pod \"b87fd570-9f27-4cca-9d39-3c634a7755fa\" (UID: \"b87fd570-9f27-4cca-9d39-3c634a7755fa\") " Jul 06 19:33:39.124195 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.124056 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkqbz\" (UniqueName: \"kubernetes.io/projected/010a9b62-cd05-44ec-b293-3443cf39e135-kube-api-access-rkqbz\") pod \"010a9b62-cd05-44ec-b293-3443cf39e135\" (UID: \"010a9b62-cd05-44ec-b293-3443cf39e135\") " Jul 06 19:33:39.124542 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.124500 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-bundle" (OuterVolumeSpecName: "bundle") pod "b87fd570-9f27-4cca-9d39-3c634a7755fa" (UID: "b87fd570-9f27-4cca-9d39-3c634a7755fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:39.124542 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.124521 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-bundle" (OuterVolumeSpecName: "bundle") pod "010a9b62-cd05-44ec-b293-3443cf39e135" (UID: "010a9b62-cd05-44ec-b293-3443cf39e135"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:39.126296 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.126132 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/010a9b62-cd05-44ec-b293-3443cf39e135-kube-api-access-rkqbz" (OuterVolumeSpecName: "kube-api-access-rkqbz") pod "010a9b62-cd05-44ec-b293-3443cf39e135" (UID: "010a9b62-cd05-44ec-b293-3443cf39e135"). InnerVolumeSpecName "kube-api-access-rkqbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:39.126408 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.126350 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b87fd570-9f27-4cca-9d39-3c634a7755fa-kube-api-access-4zv99" (OuterVolumeSpecName: "kube-api-access-4zv99") pod "b87fd570-9f27-4cca-9d39-3c634a7755fa" (UID: "b87fd570-9f27-4cca-9d39-3c634a7755fa"). InnerVolumeSpecName "kube-api-access-4zv99". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:33:39.129540 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.129518 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-util" (OuterVolumeSpecName: "util") pod "010a9b62-cd05-44ec-b293-3443cf39e135" (UID: "010a9b62-cd05-44ec-b293-3443cf39e135"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:39.129909 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.129889 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-util" (OuterVolumeSpecName: "util") pod "b87fd570-9f27-4cca-9d39-3c634a7755fa" (UID: "b87fd570-9f27-4cca-9d39-3c634a7755fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:33:39.224785 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.224763 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-util\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:39.224785 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.224784 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-util\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:39.224909 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.224792 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/010a9b62-cd05-44ec-b293-3443cf39e135-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:39.224909 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.224801 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zv99\" (UniqueName: \"kubernetes.io/projected/b87fd570-9f27-4cca-9d39-3c634a7755fa-kube-api-access-4zv99\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:39.224909 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.224811 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b87fd570-9f27-4cca-9d39-3c634a7755fa-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:39.224909 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.224819 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkqbz\" (UniqueName: \"kubernetes.io/projected/010a9b62-cd05-44ec-b293-3443cf39e135-kube-api-access-rkqbz\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:33:39.845983 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.845954 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" Jul 06 19:33:39.845983 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.845980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9" event={"ID":"b87fd570-9f27-4cca-9d39-3c634a7755fa","Type":"ContainerDied","Data":"6e6037231d099742cc0cc02517bc3532925b7180ee7dfe85af708a300e433f21"} Jul 06 19:33:39.846510 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.846022 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e6037231d099742cc0cc02517bc3532925b7180ee7dfe85af708a300e433f21" Jul 06 19:33:39.847827 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.847808 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" Jul 06 19:33:39.847954 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.847808 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw" event={"ID":"010a9b62-cd05-44ec-b293-3443cf39e135","Type":"ContainerDied","Data":"89fddd91df0174fe251f619ab770c7bc8be11fb0a9ce3953b4bbf42d85e99ca1"} Jul 06 19:33:39.847954 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:39.847906 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89fddd91df0174fe251f619ab770c7bc8be11fb0a9ce3953b4bbf42d85e99ca1" Jul 06 19:33:46.127591 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.127550 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66bbf674c8-pxwwt"] Jul 06 19:33:46.128089 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128067 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerName="util" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128091 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerName="util" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128104 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerName="extract" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128112 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerName="extract" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128127 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010a9b62-cd05-44ec-b293-3443cf39e135" containerName="util" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128135 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="010a9b62-cd05-44ec-b293-3443cf39e135" containerName="util" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128160 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerName="extract" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128169 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerName="extract" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128179 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerName="pull" Jul 06 19:33:46.128183 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128187 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerName="pull" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128200 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerName="pull" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128208 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerName="pull" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128233 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerName="util" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128241 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerName="util" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128250 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerName="util" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128257 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerName="util" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128268 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010a9b62-cd05-44ec-b293-3443cf39e135" containerName="extract" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128275 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="010a9b62-cd05-44ec-b293-3443cf39e135" containerName="extract" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128291 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerName="pull" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128298 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerName="pull" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128307 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010a9b62-cd05-44ec-b293-3443cf39e135" containerName="pull" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128315 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="010a9b62-cd05-44ec-b293-3443cf39e135" containerName="pull" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128326 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerName="extract" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128334 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerName="extract" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128424 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a96073-5dd1-426e-9aaa-bac3814e2ff9" containerName="extract" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128435 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b87fd570-9f27-4cca-9d39-3c634a7755fa" containerName="extract" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128445 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9183e870-af6e-42fc-b21e-a3e16f5ff7df" containerName="extract" Jul 06 19:33:46.128593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.128473 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="010a9b62-cd05-44ec-b293-3443cf39e135" containerName="extract" Jul 06 19:33:46.130817 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.130797 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.148328 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.148304 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bbf674c8-pxwwt"] Jul 06 19:33:46.280179 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.280130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-service-ca\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.280349 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.280192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-oauth-config\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.280349 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.280268 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-trusted-ca-bundle\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.280349 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.280297 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pvp9\" (UniqueName: \"kubernetes.io/projected/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-kube-api-access-4pvp9\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.280349 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.280317 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-serving-cert\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.280490 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.280389 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-config\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.280490 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.280421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-oauth-serving-cert\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.381295 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.381201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-config\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.381295 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.381255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-oauth-serving-cert\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.381295 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.381288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-service-ca\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.381573 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.381322 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-oauth-config\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.381573 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.381363 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-trusted-ca-bundle\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.381573 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.381385 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pvp9\" (UniqueName: \"kubernetes.io/projected/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-kube-api-access-4pvp9\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.381573 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.381409 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-serving-cert\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.382082 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.382040 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-service-ca\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.382240 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.382043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-config\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.382240 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.382117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-oauth-serving-cert\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.382355 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.382299 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-trusted-ca-bundle\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.383886 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.383862 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-oauth-config\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.383991 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.383965 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-console-serving-cert\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.401607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.401582 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pvp9\" (UniqueName: \"kubernetes.io/projected/f28ee9a6-7c2a-4657-946b-5b61b1deca8e-kube-api-access-4pvp9\") pod \"console-66bbf674c8-pxwwt\" (UID: \"f28ee9a6-7c2a-4657-946b-5b61b1deca8e\") " pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.439634 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.439604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:46.581354 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.581329 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66bbf674c8-pxwwt"] Jul 06 19:33:46.583201 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:33:46.583176 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28ee9a6_7c2a_4657_946b_5b61b1deca8e.slice/crio-fe8904c2c617f33c3a348707c1c93f166efa0d3159796ecee0461bec32c8cf09 WatchSource:0}: Error finding container fe8904c2c617f33c3a348707c1c93f166efa0d3159796ecee0461bec32c8cf09: Status 404 returned error can't find the container with id fe8904c2c617f33c3a348707c1c93f166efa0d3159796ecee0461bec32c8cf09 Jul 06 19:33:46.884437 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.884353 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bbf674c8-pxwwt" event={"ID":"f28ee9a6-7c2a-4657-946b-5b61b1deca8e","Type":"ContainerStarted","Data":"8aad30e3dd6c91e2e8333d634d70ce9c781941c7a8a4393f078999d76f524ce4"} Jul 06 19:33:46.884437 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.884403 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66bbf674c8-pxwwt" event={"ID":"f28ee9a6-7c2a-4657-946b-5b61b1deca8e","Type":"ContainerStarted","Data":"fe8904c2c617f33c3a348707c1c93f166efa0d3159796ecee0461bec32c8cf09"} Jul 06 19:33:46.913768 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:46.913709 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66bbf674c8-pxwwt" podStartSLOduration=0.913690532 podStartE2EDuration="913.690532ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:46.911327594 +0000 UTC m=+478.668497088" watchObservedRunningTime="2026-07-06 19:33:46.913690532 +0000 UTC m=+478.670860070" Jul 06 19:33:56.440802 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:56.440762 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:56.441258 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:56.440863 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:56.445470 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:56.445449 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:56.946621 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:56.946595 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66bbf674c8-pxwwt" Jul 06 19:33:57.028351 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:33:57.028320 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9cb54f89-297kc"] Jul 06 19:34:01.808616 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.808585 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg"] Jul 06 19:34:01.813945 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.813925 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:01.818226 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.818140 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rqz87\"" Jul 06 19:34:01.818357 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.818265 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 19:34:01.818357 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.818289 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 19:34:01.828437 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.828417 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg"] Jul 06 19:34:01.920421 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.920377 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2275bcc5-439d-4daa-8467-c460db0c9c80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:01.920594 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:01.920437 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwkqk\" (UniqueName: \"kubernetes.io/projected/2275bcc5-439d-4daa-8467-c460db0c9c80-kube-api-access-hwkqk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:02.021694 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:02.021651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2275bcc5-439d-4daa-8467-c460db0c9c80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:02.021884 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:02.021705 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwkqk\" (UniqueName: \"kubernetes.io/projected/2275bcc5-439d-4daa-8467-c460db0c9c80-kube-api-access-hwkqk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:02.022028 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:02.022007 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2275bcc5-439d-4daa-8467-c460db0c9c80-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:02.029979 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:02.029951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwkqk\" (UniqueName: \"kubernetes.io/projected/2275bcc5-439d-4daa-8467-c460db0c9c80-kube-api-access-hwkqk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:02.124057 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:02.124016 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:02.260868 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:02.260843 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg"] Jul 06 19:34:02.263063 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:34:02.263034 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2275bcc5_439d_4daa_8467_c460db0c9c80.slice/crio-acb2d1c88d5e6e127d98a016b14d3514fd38f3c5a81d0ed13317fd4e4c049f18 WatchSource:0}: Error finding container acb2d1c88d5e6e127d98a016b14d3514fd38f3c5a81d0ed13317fd4e4c049f18: Status 404 returned error can't find the container with id acb2d1c88d5e6e127d98a016b14d3514fd38f3c5a81d0ed13317fd4e4c049f18 Jul 06 19:34:02.981191 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:02.981137 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" event={"ID":"2275bcc5-439d-4daa-8467-c460db0c9c80","Type":"ContainerStarted","Data":"acb2d1c88d5e6e127d98a016b14d3514fd38f3c5a81d0ed13317fd4e4c049f18"} Jul 06 19:34:08.011897 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:08.011807 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" event={"ID":"2275bcc5-439d-4daa-8467-c460db0c9c80","Type":"ContainerStarted","Data":"c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d"} Jul 06 19:34:08.012291 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:08.011920 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:08.035941 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:08.035890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" podStartSLOduration=1.560523312 podStartE2EDuration="7.035875412s" totalImagesPullingTime="5.4753521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:08.034267347 +0000 UTC m=+499.791436835" watchObservedRunningTime="2026-07-06 19:34:08.035875412 +0000 UTC m=+499.793044899" Jul 06 19:34:19.020481 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:19.020451 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:21.055110 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.055074 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg"] Jul 06 19:34:21.055602 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.055263 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" containerName="manager" containerID="cri-o://c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d" gracePeriod=2 Jul 06 19:34:21.073040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.073012 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg"] Jul 06 19:34:21.118871 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.118830 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd"] Jul 06 19:34:21.119408 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.119393 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" containerName="manager" Jul 06 19:34:21.119455 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.119413 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" containerName="manager" Jul 06 19:34:21.119509 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.119498 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" containerName="manager" Jul 06 19:34:21.123078 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.123051 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.127222 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:21.127185 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:21.154988 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.154958 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd"] Jul 06 19:34:21.299591 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.299555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de08ab7-7bc8-43f2-88fc-668daf0561f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xsmhd\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.299724 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.299676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zrl\" (UniqueName: \"kubernetes.io/projected/3de08ab7-7bc8-43f2-88fc-668daf0561f9-kube-api-access-z6zrl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xsmhd\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.309385 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.309327 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:21.314125 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:21.314094 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:21.335013 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.334980 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8"] Jul 06 19:34:21.338495 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.338479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.371606 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.371569 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8"] Jul 06 19:34:21.400810 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.400780 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwkqk\" (UniqueName: \"kubernetes.io/projected/2275bcc5-439d-4daa-8467-c460db0c9c80-kube-api-access-hwkqk\") pod \"2275bcc5-439d-4daa-8467-c460db0c9c80\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " Jul 06 19:34:21.400972 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.400881 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2275bcc5-439d-4daa-8467-c460db0c9c80-extensions-socket-volume\") pod \"2275bcc5-439d-4daa-8467-c460db0c9c80\" (UID: \"2275bcc5-439d-4daa-8467-c460db0c9c80\") " Jul 06 19:34:21.401040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.400985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de08ab7-7bc8-43f2-88fc-668daf0561f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xsmhd\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.401040 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.401024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zrl\" (UniqueName: \"kubernetes.io/projected/3de08ab7-7bc8-43f2-88fc-668daf0561f9-kube-api-access-z6zrl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xsmhd\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.401423 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.401393 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de08ab7-7bc8-43f2-88fc-668daf0561f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xsmhd\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.401423 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.401409 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2275bcc5-439d-4daa-8467-c460db0c9c80-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2275bcc5-439d-4daa-8467-c460db0c9c80" (UID: "2275bcc5-439d-4daa-8467-c460db0c9c80"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:34:21.402877 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.402855 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2275bcc5-439d-4daa-8467-c460db0c9c80-kube-api-access-hwkqk" (OuterVolumeSpecName: "kube-api-access-hwkqk") pod "2275bcc5-439d-4daa-8467-c460db0c9c80" (UID: "2275bcc5-439d-4daa-8467-c460db0c9c80"). InnerVolumeSpecName "kube-api-access-hwkqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:21.427605 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:21.427559 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:21.433808 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.433782 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zrl\" (UniqueName: \"kubernetes.io/projected/3de08ab7-7bc8-43f2-88fc-668daf0561f9-kube-api-access-z6zrl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xsmhd\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.439601 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.439566 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:21.502491 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.502457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf8mz\" (UniqueName: \"kubernetes.io/projected/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-kube-api-access-hf8mz\") pod \"kuadrant-operator-controller-manager-86878c769f-rnlf8\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.502631 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.502530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rnlf8\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.502674 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.502649 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2275bcc5-439d-4daa-8467-c460db0c9c80-extensions-socket-volume\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:21.502708 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.502674 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwkqk\" (UniqueName: \"kubernetes.io/projected/2275bcc5-439d-4daa-8467-c460db0c9c80-kube-api-access-hwkqk\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:21.592125 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.592100 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd"] Jul 06 19:34:21.593363 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:34:21.593336 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de08ab7_7bc8_43f2_88fc_668daf0561f9.slice/crio-83db3786aa1a64f352a5e7c816564dfbe68162288b071a9f4826119c18cc6870 WatchSource:0}: Error finding container 83db3786aa1a64f352a5e7c816564dfbe68162288b071a9f4826119c18cc6870: Status 404 returned error can't find the container with id 83db3786aa1a64f352a5e7c816564dfbe68162288b071a9f4826119c18cc6870 Jul 06 19:34:21.603927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.603903 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rnlf8\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.603978 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.603958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf8mz\" (UniqueName: \"kubernetes.io/projected/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-kube-api-access-hf8mz\") pod \"kuadrant-operator-controller-manager-86878c769f-rnlf8\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.604340 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.604319 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rnlf8\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.617110 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.617087 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf8mz\" (UniqueName: \"kubernetes.io/projected/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-kube-api-access-hf8mz\") pod \"kuadrant-operator-controller-manager-86878c769f-rnlf8\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.648261 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.648242 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:21.825549 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:21.825527 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8"] Jul 06 19:34:21.827271 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:34:21.827248 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce5c0bed_3407_4c72_b75b_6e0b97c6f506.slice/crio-39e8a21038299ca9340336cced14ffed33b78183b1b0de7fc9bd7dffe0353d51 WatchSource:0}: Error finding container 39e8a21038299ca9340336cced14ffed33b78183b1b0de7fc9bd7dffe0353d51: Status 404 returned error can't find the container with id 39e8a21038299ca9340336cced14ffed33b78183b1b0de7fc9bd7dffe0353d51 Jul 06 19:34:22.048312 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.048269 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f9cb54f89-297kc" podUID="780feae0-c0c8-4525-ad85-5bcb7ac97f2b" containerName="console" containerID="cri-o://1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc" gracePeriod=15 Jul 06 19:34:22.094198 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.094102 2563 generic.go:356] "Generic (PLEG): container finished" podID="2275bcc5-439d-4daa-8467-c460db0c9c80" containerID="c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d" exitCode=0 Jul 06 19:34:22.094198 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.094179 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:22.094678 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.094190 2563 scope.go:117] "RemoveContainer" containerID="c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d" Jul 06 19:34:22.096051 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.096026 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerStarted","Data":"75dc04498c179715a0ceb96e844930e432ff11b6e9a45da0edadeed9f249deaf"} Jul 06 19:34:22.096166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.096104 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerStarted","Data":"39e8a21038299ca9340336cced14ffed33b78183b1b0de7fc9bd7dffe0353d51"} Jul 06 19:34:22.096166 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.096133 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:22.096316 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:22.096290 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:22.097695 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.097674 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" event={"ID":"3de08ab7-7bc8-43f2-88fc-668daf0561f9","Type":"ContainerStarted","Data":"adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc"} Jul 06 19:34:22.097773 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.097718 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" event={"ID":"3de08ab7-7bc8-43f2-88fc-668daf0561f9","Type":"ContainerStarted","Data":"83db3786aa1a64f352a5e7c816564dfbe68162288b071a9f4826119c18cc6870"} Jul 06 19:34:22.097815 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.097776 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:22.098231 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:22.098211 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:22.124729 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:22.124681 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:22.125516 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.125473 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" podStartSLOduration=1.125458215 podStartE2EDuration="1.125458215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:22.120928805 +0000 UTC m=+513.878098293" watchObservedRunningTime="2026-07-06 19:34:22.125458215 +0000 UTC m=+513.882627703" Jul 06 19:34:22.155527 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.155466 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" podStartSLOduration=1.155446334 podStartE2EDuration="1.155446334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:22.151913161 +0000 UTC m=+513.909082649" watchObservedRunningTime="2026-07-06 19:34:22.155446334 +0000 UTC m=+513.912615824" Jul 06 19:34:22.160679 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.160660 2563 scope.go:117] "RemoveContainer" containerID="c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d" Jul 06 19:34:22.160967 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:22.160949 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d\": container with ID starting with c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d not found: ID does not exist" containerID="c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d" Jul 06 19:34:22.161011 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.160978 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d"} err="failed to get container status \"c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d\": rpc error: code = NotFound desc = could not find container \"c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d\": container with ID starting with c9388f1373f0bdafb7d592a97eb7013645fe29daba022a21dc28c95d69224e2d not found: ID does not exist" Jul 06 19:34:22.301511 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.301488 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:34:22.333645 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:22.333605 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-fwnrg\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwnrg" Jul 06 19:34:22.412557 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.412517 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-trusted-ca-bundle\") pod \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " Jul 06 19:34:22.412557 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.412572 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lvr2\" (UniqueName: \"kubernetes.io/projected/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-kube-api-access-6lvr2\") pod \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " Jul 06 19:34:22.412849 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.412616 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-config\") pod \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " Jul 06 19:34:22.412849 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.412651 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-oauth-config\") pod \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " Jul 06 19:34:22.412849 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.412684 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-service-ca\") pod \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " Jul 06 19:34:22.412849 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.412719 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-oauth-serving-cert\") pod \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " Jul 06 19:34:22.412849 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.412748 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-serving-cert\") pod \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\" (UID: \"780feae0-c0c8-4525-ad85-5bcb7ac97f2b\") " Jul 06 19:34:22.413279 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.413243 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-config" (OuterVolumeSpecName: "console-config") pod "780feae0-c0c8-4525-ad85-5bcb7ac97f2b" (UID: "780feae0-c0c8-4525-ad85-5bcb7ac97f2b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:34:22.413405 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.413360 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-service-ca" (OuterVolumeSpecName: "service-ca") pod "780feae0-c0c8-4525-ad85-5bcb7ac97f2b" (UID: "780feae0-c0c8-4525-ad85-5bcb7ac97f2b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:34:22.414180 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.413537 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "780feae0-c0c8-4525-ad85-5bcb7ac97f2b" (UID: "780feae0-c0c8-4525-ad85-5bcb7ac97f2b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:34:22.414180 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.413937 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "780feae0-c0c8-4525-ad85-5bcb7ac97f2b" (UID: "780feae0-c0c8-4525-ad85-5bcb7ac97f2b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:34:22.415819 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.415797 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "780feae0-c0c8-4525-ad85-5bcb7ac97f2b" (UID: "780feae0-c0c8-4525-ad85-5bcb7ac97f2b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:34:22.416619 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.416592 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-kube-api-access-6lvr2" (OuterVolumeSpecName: "kube-api-access-6lvr2") pod "780feae0-c0c8-4525-ad85-5bcb7ac97f2b" (UID: "780feae0-c0c8-4525-ad85-5bcb7ac97f2b"). InnerVolumeSpecName "kube-api-access-6lvr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:22.417118 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.417099 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "780feae0-c0c8-4525-ad85-5bcb7ac97f2b" (UID: "780feae0-c0c8-4525-ad85-5bcb7ac97f2b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:34:22.514015 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.513978 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:22.514015 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.514014 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-trusted-ca-bundle\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:22.514294 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.514027 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lvr2\" (UniqueName: \"kubernetes.io/projected/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-kube-api-access-6lvr2\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:22.514294 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.514039 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:22.514294 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.514051 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-console-oauth-config\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:22.514294 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.514061 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-service-ca\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:22.514294 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.514082 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/780feae0-c0c8-4525-ad85-5bcb7ac97f2b-oauth-serving-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:22.811055 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:22.810967 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2275bcc5-439d-4daa-8467-c460db0c9c80" path="/var/lib/kubelet/pods/2275bcc5-439d-4daa-8467-c460db0c9c80/volumes" Jul 06 19:34:23.104527 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.104444 2563 generic.go:356] "Generic (PLEG): container finished" podID="780feae0-c0c8-4525-ad85-5bcb7ac97f2b" containerID="1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc" exitCode=0 Jul 06 19:34:23.104527 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.104491 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9cb54f89-297kc" Jul 06 19:34:23.105006 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.104532 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cb54f89-297kc" event={"ID":"780feae0-c0c8-4525-ad85-5bcb7ac97f2b","Type":"ContainerDied","Data":"1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc"} Jul 06 19:34:23.105006 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.104593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9cb54f89-297kc" event={"ID":"780feae0-c0c8-4525-ad85-5bcb7ac97f2b","Type":"ContainerDied","Data":"d10eb5d5ebad47532606a925328dbb1bba55cff28294245948427ff9ca297dca"} Jul 06 19:34:23.105006 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.104623 2563 scope.go:117] "RemoveContainer" containerID="1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc" Jul 06 19:34:23.115019 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.115001 2563 scope.go:117] "RemoveContainer" containerID="1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc" Jul 06 19:34:23.115411 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:23.115391 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc\": container with ID starting with 1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc not found: ID does not exist" containerID="1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc" Jul 06 19:34:23.115465 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.115417 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc"} err="failed to get container status \"1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc\": rpc error: code = NotFound desc = could not find container \"1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc\": container with ID starting with 1ff8bc981005af68df661e1220e3ac50dada872573ac6e19a540e1fa8fff6dcc not found: ID does not exist" Jul 06 19:34:23.194311 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.194287 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f9cb54f89-297kc"] Jul 06 19:34:23.329087 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:23.329054 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f9cb54f89-297kc"] Jul 06 19:34:24.811010 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:24.810978 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780feae0-c0c8-4525-ad85-5bcb7ac97f2b" path="/var/lib/kubelet/pods/780feae0-c0c8-4525-ad85-5bcb7ac97f2b/volumes" Jul 06 19:34:33.107814 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.107783 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:33.108330 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.107932 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:34:33.285925 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.285898 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd"] Jul 06 19:34:33.286158 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.286120 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" podUID="3de08ab7-7bc8-43f2-88fc-668daf0561f9" containerName="manager" containerID="cri-o://adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc" gracePeriod=10 Jul 06 19:34:33.537363 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.537337 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:33.611309 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.611278 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6zrl\" (UniqueName: \"kubernetes.io/projected/3de08ab7-7bc8-43f2-88fc-668daf0561f9-kube-api-access-z6zrl\") pod \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " Jul 06 19:34:33.611474 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.611359 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de08ab7-7bc8-43f2-88fc-668daf0561f9-extensions-socket-volume\") pod \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\" (UID: \"3de08ab7-7bc8-43f2-88fc-668daf0561f9\") " Jul 06 19:34:33.611730 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.611700 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3de08ab7-7bc8-43f2-88fc-668daf0561f9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3de08ab7-7bc8-43f2-88fc-668daf0561f9" (UID: "3de08ab7-7bc8-43f2-88fc-668daf0561f9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:34:33.613360 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.613339 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3de08ab7-7bc8-43f2-88fc-668daf0561f9-kube-api-access-z6zrl" (OuterVolumeSpecName: "kube-api-access-z6zrl") pod "3de08ab7-7bc8-43f2-88fc-668daf0561f9" (UID: "3de08ab7-7bc8-43f2-88fc-668daf0561f9"). InnerVolumeSpecName "kube-api-access-z6zrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:34:33.712116 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.712029 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3de08ab7-7bc8-43f2-88fc-668daf0561f9-extensions-socket-volume\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:33.712116 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:33.712062 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6zrl\" (UniqueName: \"kubernetes.io/projected/3de08ab7-7bc8-43f2-88fc-668daf0561f9-kube-api-access-z6zrl\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:34:34.165141 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.165105 2563 generic.go:356] "Generic (PLEG): container finished" podID="3de08ab7-7bc8-43f2-88fc-668daf0561f9" containerID="adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc" exitCode=0 Jul 06 19:34:34.165554 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.165171 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" Jul 06 19:34:34.165554 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.165189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" event={"ID":"3de08ab7-7bc8-43f2-88fc-668daf0561f9","Type":"ContainerDied","Data":"adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc"} Jul 06 19:34:34.165554 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.165246 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd" event={"ID":"3de08ab7-7bc8-43f2-88fc-668daf0561f9","Type":"ContainerDied","Data":"83db3786aa1a64f352a5e7c816564dfbe68162288b071a9f4826119c18cc6870"} Jul 06 19:34:34.165554 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.165268 2563 scope.go:117] "RemoveContainer" containerID="adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc" Jul 06 19:34:34.173651 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.173632 2563 scope.go:117] "RemoveContainer" containerID="adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc" Jul 06 19:34:34.173922 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:34:34.173898 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc\": container with ID starting with adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc not found: ID does not exist" containerID="adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc" Jul 06 19:34:34.173980 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.173930 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc"} err="failed to get container status \"adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc\": rpc error: code = NotFound desc = could not find container \"adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc\": container with ID starting with adabc6c1f0ffb36ac10b80e361d4e2560e9d2ead207c6e26767e699f246b0fcc not found: ID does not exist" Jul 06 19:34:34.199075 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.199050 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd"] Jul 06 19:34:34.203864 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.203843 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xsmhd"] Jul 06 19:34:34.810303 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:34.810262 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3de08ab7-7bc8-43f2-88fc-668daf0561f9" path="/var/lib/kubelet/pods/3de08ab7-7bc8-43f2-88fc-668daf0561f9/volumes" Jul 06 19:34:53.555748 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.555714 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rp54h"] Jul 06 19:34:53.556108 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.556070 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780feae0-c0c8-4525-ad85-5bcb7ac97f2b" containerName="console" Jul 06 19:34:53.556108 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.556081 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="780feae0-c0c8-4525-ad85-5bcb7ac97f2b" containerName="console" Jul 06 19:34:53.556108 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.556101 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3de08ab7-7bc8-43f2-88fc-668daf0561f9" containerName="manager" Jul 06 19:34:53.556108 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.556106 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3de08ab7-7bc8-43f2-88fc-668daf0561f9" containerName="manager" Jul 06 19:34:53.556265 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.556183 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="780feae0-c0c8-4525-ad85-5bcb7ac97f2b" containerName="console" Jul 06 19:34:53.556265 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.556193 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3de08ab7-7bc8-43f2-88fc-668daf0561f9" containerName="manager" Jul 06 19:34:53.560498 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.560480 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rp54h" Jul 06 19:34:53.562794 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.562753 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xpgsw\"" Jul 06 19:34:53.570862 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.570840 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rp54h"] Jul 06 19:34:53.674946 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.674914 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm6fp\" (UniqueName: \"kubernetes.io/projected/f5546213-c89c-4e15-9b92-3ff1ed44825b-kube-api-access-fm6fp\") pod \"authorino-58cd955675-rp54h\" (UID: \"f5546213-c89c-4e15-9b92-3ff1ed44825b\") " pod="kuadrant-system/authorino-58cd955675-rp54h" Jul 06 19:34:53.742774 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.742733 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-z45jt"] Jul 06 19:34:53.746341 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.746319 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z45jt" Jul 06 19:34:53.755975 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.755944 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z45jt"] Jul 06 19:34:53.775694 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.775663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm6fp\" (UniqueName: \"kubernetes.io/projected/f5546213-c89c-4e15-9b92-3ff1ed44825b-kube-api-access-fm6fp\") pod \"authorino-58cd955675-rp54h\" (UID: \"f5546213-c89c-4e15-9b92-3ff1ed44825b\") " pod="kuadrant-system/authorino-58cd955675-rp54h" Jul 06 19:34:53.783871 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.783848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm6fp\" (UniqueName: \"kubernetes.io/projected/f5546213-c89c-4e15-9b92-3ff1ed44825b-kube-api-access-fm6fp\") pod \"authorino-58cd955675-rp54h\" (UID: \"f5546213-c89c-4e15-9b92-3ff1ed44825b\") " pod="kuadrant-system/authorino-58cd955675-rp54h" Jul 06 19:34:53.869680 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.869657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rp54h" Jul 06 19:34:53.876954 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.876927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdrzl\" (UniqueName: \"kubernetes.io/projected/7ff95b01-52d1-458b-9c11-c6873ef9652b-kube-api-access-pdrzl\") pod \"authorino-75d556bd77-z45jt\" (UID: \"7ff95b01-52d1-458b-9c11-c6873ef9652b\") " pod="kuadrant-system/authorino-75d556bd77-z45jt" Jul 06 19:34:53.978216 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.978185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdrzl\" (UniqueName: \"kubernetes.io/projected/7ff95b01-52d1-458b-9c11-c6873ef9652b-kube-api-access-pdrzl\") pod \"authorino-75d556bd77-z45jt\" (UID: \"7ff95b01-52d1-458b-9c11-c6873ef9652b\") " pod="kuadrant-system/authorino-75d556bd77-z45jt" Jul 06 19:34:53.986929 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.986904 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdrzl\" (UniqueName: \"kubernetes.io/projected/7ff95b01-52d1-458b-9c11-c6873ef9652b-kube-api-access-pdrzl\") pod \"authorino-75d556bd77-z45jt\" (UID: \"7ff95b01-52d1-458b-9c11-c6873ef9652b\") " pod="kuadrant-system/authorino-75d556bd77-z45jt" Jul 06 19:34:53.997028 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:53.997008 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rp54h"] Jul 06 19:34:53.999086 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:34:53.999062 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5546213_c89c_4e15_9b92_3ff1ed44825b.slice/crio-c2106e0c5d33ab9a2b471b7ca62a0563a4c7ab3d0f8b4a34db1dd1a72f1c8f7e WatchSource:0}: Error finding container c2106e0c5d33ab9a2b471b7ca62a0563a4c7ab3d0f8b4a34db1dd1a72f1c8f7e: Status 404 returned error can't find the container with id c2106e0c5d33ab9a2b471b7ca62a0563a4c7ab3d0f8b4a34db1dd1a72f1c8f7e Jul 06 19:34:54.055900 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:54.055876 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z45jt" Jul 06 19:34:54.209174 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:54.209136 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z45jt"] Jul 06 19:34:54.211492 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:34:54.211470 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ff95b01_52d1_458b_9c11_c6873ef9652b.slice/crio-a7d900d468ae595db38a586cc1f8aaf32b3e7daa6ddd2977f059ac1e97dcc37f WatchSource:0}: Error finding container a7d900d468ae595db38a586cc1f8aaf32b3e7daa6ddd2977f059ac1e97dcc37f: Status 404 returned error can't find the container with id a7d900d468ae595db38a586cc1f8aaf32b3e7daa6ddd2977f059ac1e97dcc37f Jul 06 19:34:54.266743 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:54.266700 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z45jt" event={"ID":"7ff95b01-52d1-458b-9c11-c6873ef9652b","Type":"ContainerStarted","Data":"a7d900d468ae595db38a586cc1f8aaf32b3e7daa6ddd2977f059ac1e97dcc37f"} Jul 06 19:34:54.267774 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:54.267752 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rp54h" event={"ID":"f5546213-c89c-4e15-9b92-3ff1ed44825b","Type":"ContainerStarted","Data":"c2106e0c5d33ab9a2b471b7ca62a0563a4c7ab3d0f8b4a34db1dd1a72f1c8f7e"} Jul 06 19:34:58.301618 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:58.301581 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z45jt" event={"ID":"7ff95b01-52d1-458b-9c11-c6873ef9652b","Type":"ContainerStarted","Data":"00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1"} Jul 06 19:34:58.303010 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:58.302986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rp54h" event={"ID":"f5546213-c89c-4e15-9b92-3ff1ed44825b","Type":"ContainerStarted","Data":"10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8"} Jul 06 19:34:58.320223 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:58.320172 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-z45jt" podStartSLOduration=2.120465116 podStartE2EDuration="5.320155511s" totalImagesPullingTime="3.199690395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:58.317778904 +0000 UTC m=+550.074948393" watchObservedRunningTime="2026-07-06 19:34:58.320155511 +0000 UTC m=+550.077324994" Jul 06 19:34:58.342342 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:58.342290 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rp54h" podStartSLOduration=1.918957807 podStartE2EDuration="5.342273157s" totalImagesPullingTime="3.42331535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:34:58.339527466 +0000 UTC m=+550.096696955" watchObservedRunningTime="2026-07-06 19:34:58.342273157 +0000 UTC m=+550.099442649" Jul 06 19:34:58.358191 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:34:58.358165 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rp54h"] Jul 06 19:35:00.313008 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:00.312969 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rp54h" podUID="f5546213-c89c-4e15-9b92-3ff1ed44825b" containerName="authorino" containerID="cri-o://10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8" gracePeriod=30 Jul 06 19:35:00.558370 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:00.558342 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rp54h" Jul 06 19:35:00.638969 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:00.638943 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fm6fp\" (UniqueName: \"kubernetes.io/projected/f5546213-c89c-4e15-9b92-3ff1ed44825b-kube-api-access-fm6fp\") pod \"f5546213-c89c-4e15-9b92-3ff1ed44825b\" (UID: \"f5546213-c89c-4e15-9b92-3ff1ed44825b\") " Jul 06 19:35:00.641033 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:00.641002 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5546213-c89c-4e15-9b92-3ff1ed44825b-kube-api-access-fm6fp" (OuterVolumeSpecName: "kube-api-access-fm6fp") pod "f5546213-c89c-4e15-9b92-3ff1ed44825b" (UID: "f5546213-c89c-4e15-9b92-3ff1ed44825b"). InnerVolumeSpecName "kube-api-access-fm6fp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:00.739543 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:00.739506 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fm6fp\" (UniqueName: \"kubernetes.io/projected/f5546213-c89c-4e15-9b92-3ff1ed44825b-kube-api-access-fm6fp\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:35:01.319366 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.319332 2563 generic.go:356] "Generic (PLEG): container finished" podID="f5546213-c89c-4e15-9b92-3ff1ed44825b" containerID="10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8" exitCode=0 Jul 06 19:35:01.319749 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.319375 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rp54h" Jul 06 19:35:01.319749 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.319417 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rp54h" event={"ID":"f5546213-c89c-4e15-9b92-3ff1ed44825b","Type":"ContainerDied","Data":"10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8"} Jul 06 19:35:01.319749 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.319454 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rp54h" event={"ID":"f5546213-c89c-4e15-9b92-3ff1ed44825b","Type":"ContainerDied","Data":"c2106e0c5d33ab9a2b471b7ca62a0563a4c7ab3d0f8b4a34db1dd1a72f1c8f7e"} Jul 06 19:35:01.319749 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.319472 2563 scope.go:117] "RemoveContainer" containerID="10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8" Jul 06 19:35:01.327814 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.327797 2563 scope.go:117] "RemoveContainer" containerID="10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8" Jul 06 19:35:01.328039 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:35:01.328021 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8\": container with ID starting with 10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8 not found: ID does not exist" containerID="10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8" Jul 06 19:35:01.328086 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.328047 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8"} err="failed to get container status \"10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8\": rpc error: code = NotFound desc = could not find container \"10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8\": container with ID starting with 10f94eb263f07a33b105a85f402000caad7d2ff5c70946ed2a2ded423a988fe8 not found: ID does not exist" Jul 06 19:35:01.349579 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.349546 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rp54h"] Jul 06 19:35:01.353757 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:01.353734 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rp54h"] Jul 06 19:35:02.810728 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:02.810698 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5546213-c89c-4e15-9b92-3ff1ed44825b" path="/var/lib/kubelet/pods/f5546213-c89c-4e15-9b92-3ff1ed44825b/volumes" Jul 06 19:35:26.690829 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.690795 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h2cqv"] Jul 06 19:35:26.691296 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.691165 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5546213-c89c-4e15-9b92-3ff1ed44825b" containerName="authorino" Jul 06 19:35:26.691296 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.691178 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5546213-c89c-4e15-9b92-3ff1ed44825b" containerName="authorino" Jul 06 19:35:26.691296 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.691250 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5546213-c89c-4e15-9b92-3ff1ed44825b" containerName="authorino" Jul 06 19:35:26.695716 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.695700 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" Jul 06 19:35:26.713845 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.713811 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h2cqv"] Jul 06 19:35:26.758927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.758895 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz4wl\" (UniqueName: \"kubernetes.io/projected/12791a64-c473-4323-8eac-d8e76ddd05e9-kube-api-access-tz4wl\") pod \"authorino-5d4b67c446-h2cqv\" (UID: \"12791a64-c473-4323-8eac-d8e76ddd05e9\") " pod="kuadrant-system/authorino-5d4b67c446-h2cqv" Jul 06 19:35:26.860111 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.860078 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz4wl\" (UniqueName: \"kubernetes.io/projected/12791a64-c473-4323-8eac-d8e76ddd05e9-kube-api-access-tz4wl\") pod \"authorino-5d4b67c446-h2cqv\" (UID: \"12791a64-c473-4323-8eac-d8e76ddd05e9\") " pod="kuadrant-system/authorino-5d4b67c446-h2cqv" Jul 06 19:35:26.879809 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.879784 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz4wl\" (UniqueName: \"kubernetes.io/projected/12791a64-c473-4323-8eac-d8e76ddd05e9-kube-api-access-tz4wl\") pod \"authorino-5d4b67c446-h2cqv\" (UID: \"12791a64-c473-4323-8eac-d8e76ddd05e9\") " pod="kuadrant-system/authorino-5d4b67c446-h2cqv" Jul 06 19:35:26.990691 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.990612 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h2cqv"] Jul 06 19:35:26.990873 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:26.990862 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" Jul 06 19:35:27.033793 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.033575 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cdd7cff48-mpvc4"] Jul 06 19:35:27.036792 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.036769 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" Jul 06 19:35:27.051569 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.051538 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cdd7cff48-mpvc4"] Jul 06 19:35:27.061130 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.061101 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l26c\" (UniqueName: \"kubernetes.io/projected/afaec6b7-b87a-4279-8afc-0b3b7a4eee32-kube-api-access-7l26c\") pod \"authorino-6cdd7cff48-mpvc4\" (UID: \"afaec6b7-b87a-4279-8afc-0b3b7a4eee32\") " pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" Jul 06 19:35:27.131791 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.131769 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h2cqv"] Jul 06 19:35:27.133202 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:35:27.133174 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12791a64_c473_4323_8eac_d8e76ddd05e9.slice/crio-b3a83fa7a43fbc7edeafe57a17c1fd8bc8b008a59ee84b9cc40c1603051d97b0 WatchSource:0}: Error finding container b3a83fa7a43fbc7edeafe57a17c1fd8bc8b008a59ee84b9cc40c1603051d97b0: Status 404 returned error can't find the container with id b3a83fa7a43fbc7edeafe57a17c1fd8bc8b008a59ee84b9cc40c1603051d97b0 Jul 06 19:35:27.161876 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.161847 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l26c\" (UniqueName: \"kubernetes.io/projected/afaec6b7-b87a-4279-8afc-0b3b7a4eee32-kube-api-access-7l26c\") pod \"authorino-6cdd7cff48-mpvc4\" (UID: \"afaec6b7-b87a-4279-8afc-0b3b7a4eee32\") " pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" Jul 06 19:35:27.172726 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.172703 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l26c\" (UniqueName: \"kubernetes.io/projected/afaec6b7-b87a-4279-8afc-0b3b7a4eee32-kube-api-access-7l26c\") pod \"authorino-6cdd7cff48-mpvc4\" (UID: \"afaec6b7-b87a-4279-8afc-0b3b7a4eee32\") " pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" Jul 06 19:35:27.272856 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.272768 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cdd7cff48-mpvc4"] Jul 06 19:35:27.273027 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.273014 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" Jul 06 19:35:27.309459 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.309425 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-88845dfb-76s44"] Jul 06 19:35:27.312457 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.312431 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.315373 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.315351 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 06 19:35:27.326886 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.326858 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-88845dfb-76s44"] Jul 06 19:35:27.363927 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.363886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d13e760-6c7a-4fde-99ee-dc87dba411f3-tls-cert\") pod \"authorino-88845dfb-76s44\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.364117 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.364040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5n7b\" (UniqueName: \"kubernetes.io/projected/1d13e760-6c7a-4fde-99ee-dc87dba411f3-kube-api-access-z5n7b\") pod \"authorino-88845dfb-76s44\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.413988 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.413966 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cdd7cff48-mpvc4"] Jul 06 19:35:27.415652 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:35:27.415624 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafaec6b7_b87a_4279_8afc_0b3b7a4eee32.slice/crio-10261d69f335f075869e9163d2668581f710976fed1ec3bfe74b3e9110594871 WatchSource:0}: Error finding container 10261d69f335f075869e9163d2668581f710976fed1ec3bfe74b3e9110594871: Status 404 returned error can't find the container with id 10261d69f335f075869e9163d2668581f710976fed1ec3bfe74b3e9110594871 Jul 06 19:35:27.449335 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.449301 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" event={"ID":"afaec6b7-b87a-4279-8afc-0b3b7a4eee32","Type":"ContainerStarted","Data":"10261d69f335f075869e9163d2668581f710976fed1ec3bfe74b3e9110594871"} Jul 06 19:35:27.450632 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.450606 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" event={"ID":"12791a64-c473-4323-8eac-d8e76ddd05e9","Type":"ContainerStarted","Data":"b3a83fa7a43fbc7edeafe57a17c1fd8bc8b008a59ee84b9cc40c1603051d97b0"} Jul 06 19:35:27.465096 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.465071 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5n7b\" (UniqueName: \"kubernetes.io/projected/1d13e760-6c7a-4fde-99ee-dc87dba411f3-kube-api-access-z5n7b\") pod \"authorino-88845dfb-76s44\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.465212 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.465118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d13e760-6c7a-4fde-99ee-dc87dba411f3-tls-cert\") pod \"authorino-88845dfb-76s44\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.467431 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.467406 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d13e760-6c7a-4fde-99ee-dc87dba411f3-tls-cert\") pod \"authorino-88845dfb-76s44\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.475130 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.475112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5n7b\" (UniqueName: \"kubernetes.io/projected/1d13e760-6c7a-4fde-99ee-dc87dba411f3-kube-api-access-z5n7b\") pod \"authorino-88845dfb-76s44\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.624198 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.624170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:35:27.762913 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:27.762882 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-88845dfb-76s44"] Jul 06 19:35:27.770284 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:35:27.770258 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d13e760_6c7a_4fde_99ee_dc87dba411f3.slice/crio-a5e18ebc9636cbec97067d33fce63be3df882063cfbe8dd1d9fc7ef94eb3fb02 WatchSource:0}: Error finding container a5e18ebc9636cbec97067d33fce63be3df882063cfbe8dd1d9fc7ef94eb3fb02: Status 404 returned error can't find the container with id a5e18ebc9636cbec97067d33fce63be3df882063cfbe8dd1d9fc7ef94eb3fb02 Jul 06 19:35:28.457493 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.457454 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" event={"ID":"12791a64-c473-4323-8eac-d8e76ddd05e9","Type":"ContainerStarted","Data":"f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a"} Jul 06 19:35:28.457691 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.457515 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" podUID="12791a64-c473-4323-8eac-d8e76ddd05e9" containerName="authorino" containerID="cri-o://f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a" gracePeriod=30 Jul 06 19:35:28.459045 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.459018 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88845dfb-76s44" event={"ID":"1d13e760-6c7a-4fde-99ee-dc87dba411f3","Type":"ContainerStarted","Data":"f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00"} Jul 06 19:35:28.459181 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.459058 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88845dfb-76s44" event={"ID":"1d13e760-6c7a-4fde-99ee-dc87dba411f3","Type":"ContainerStarted","Data":"a5e18ebc9636cbec97067d33fce63be3df882063cfbe8dd1d9fc7ef94eb3fb02"} Jul 06 19:35:28.460541 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.460515 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" event={"ID":"afaec6b7-b87a-4279-8afc-0b3b7a4eee32","Type":"ContainerStarted","Data":"53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb"} Jul 06 19:35:28.460653 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.460544 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" podUID="afaec6b7-b87a-4279-8afc-0b3b7a4eee32" containerName="authorino" containerID="cri-o://53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb" gracePeriod=30 Jul 06 19:35:28.479085 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.479044 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" podStartSLOduration=1.868301369 podStartE2EDuration="2.479030899s" totalImagesPullingTime="610.72953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:28.478251955 +0000 UTC m=+580.235421444" watchObservedRunningTime="2026-07-06 19:35:28.479030899 +0000 UTC m=+580.236200388" Jul 06 19:35:28.503981 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.503944 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-88845dfb-76s44" podStartSLOduration=1.150465004 podStartE2EDuration="1.50393259s" totalImagesPullingTime="353.467586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:28.503579523 +0000 UTC m=+580.260749013" watchObservedRunningTime="2026-07-06 19:35:28.50393259 +0000 UTC m=+580.261102075" Jul 06 19:35:28.529716 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.529662 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" podStartSLOduration=1.229199309 podStartE2EDuration="1.529643751s" totalImagesPullingTime="300.444442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:35:28.526676769 +0000 UTC m=+580.283846258" watchObservedRunningTime="2026-07-06 19:35:28.529643751 +0000 UTC m=+580.286813240" Jul 06 19:35:28.553376 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.553341 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z45jt"] Jul 06 19:35:28.553567 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.553542 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-z45jt" podUID="7ff95b01-52d1-458b-9c11-c6873ef9652b" containerName="authorino" containerID="cri-o://00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1" gracePeriod=30 Jul 06 19:35:28.824973 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.824948 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" Jul 06 19:35:28.828450 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.828434 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" Jul 06 19:35:28.841374 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.841348 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z45jt" Jul 06 19:35:28.877328 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.877294 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdrzl\" (UniqueName: \"kubernetes.io/projected/7ff95b01-52d1-458b-9c11-c6873ef9652b-kube-api-access-pdrzl\") pod \"7ff95b01-52d1-458b-9c11-c6873ef9652b\" (UID: \"7ff95b01-52d1-458b-9c11-c6873ef9652b\") " Jul 06 19:35:28.877467 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.877336 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l26c\" (UniqueName: \"kubernetes.io/projected/afaec6b7-b87a-4279-8afc-0b3b7a4eee32-kube-api-access-7l26c\") pod \"afaec6b7-b87a-4279-8afc-0b3b7a4eee32\" (UID: \"afaec6b7-b87a-4279-8afc-0b3b7a4eee32\") " Jul 06 19:35:28.877467 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.877385 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tz4wl\" (UniqueName: \"kubernetes.io/projected/12791a64-c473-4323-8eac-d8e76ddd05e9-kube-api-access-tz4wl\") pod \"12791a64-c473-4323-8eac-d8e76ddd05e9\" (UID: \"12791a64-c473-4323-8eac-d8e76ddd05e9\") " Jul 06 19:35:28.879514 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.879480 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12791a64-c473-4323-8eac-d8e76ddd05e9-kube-api-access-tz4wl" (OuterVolumeSpecName: "kube-api-access-tz4wl") pod "12791a64-c473-4323-8eac-d8e76ddd05e9" (UID: "12791a64-c473-4323-8eac-d8e76ddd05e9"). InnerVolumeSpecName "kube-api-access-tz4wl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:28.879514 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.879499 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ff95b01-52d1-458b-9c11-c6873ef9652b-kube-api-access-pdrzl" (OuterVolumeSpecName: "kube-api-access-pdrzl") pod "7ff95b01-52d1-458b-9c11-c6873ef9652b" (UID: "7ff95b01-52d1-458b-9c11-c6873ef9652b"). InnerVolumeSpecName "kube-api-access-pdrzl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:28.879674 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.879542 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afaec6b7-b87a-4279-8afc-0b3b7a4eee32-kube-api-access-7l26c" (OuterVolumeSpecName: "kube-api-access-7l26c") pod "afaec6b7-b87a-4279-8afc-0b3b7a4eee32" (UID: "afaec6b7-b87a-4279-8afc-0b3b7a4eee32"). InnerVolumeSpecName "kube-api-access-7l26c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:35:28.978549 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.978456 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l26c\" (UniqueName: \"kubernetes.io/projected/afaec6b7-b87a-4279-8afc-0b3b7a4eee32-kube-api-access-7l26c\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:35:28.978549 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.978485 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tz4wl\" (UniqueName: \"kubernetes.io/projected/12791a64-c473-4323-8eac-d8e76ddd05e9-kube-api-access-tz4wl\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:35:28.978549 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:28.978495 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdrzl\" (UniqueName: \"kubernetes.io/projected/7ff95b01-52d1-458b-9c11-c6873ef9652b-kube-api-access-pdrzl\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:35:29.467725 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.467676 2563 generic.go:356] "Generic (PLEG): container finished" podID="afaec6b7-b87a-4279-8afc-0b3b7a4eee32" containerID="53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb" exitCode=0 Jul 06 19:35:29.467914 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.467735 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" Jul 06 19:35:29.467914 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.467768 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" event={"ID":"afaec6b7-b87a-4279-8afc-0b3b7a4eee32","Type":"ContainerDied","Data":"53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb"} Jul 06 19:35:29.467914 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.467833 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cdd7cff48-mpvc4" event={"ID":"afaec6b7-b87a-4279-8afc-0b3b7a4eee32","Type":"ContainerDied","Data":"10261d69f335f075869e9163d2668581f710976fed1ec3bfe74b3e9110594871"} Jul 06 19:35:29.467914 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.467855 2563 scope.go:117] "RemoveContainer" containerID="53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb" Jul 06 19:35:29.469331 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.469307 2563 generic.go:356] "Generic (PLEG): container finished" podID="7ff95b01-52d1-458b-9c11-c6873ef9652b" containerID="00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1" exitCode=0 Jul 06 19:35:29.469448 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.469355 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-z45jt" Jul 06 19:35:29.469448 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.469399 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z45jt" event={"ID":"7ff95b01-52d1-458b-9c11-c6873ef9652b","Type":"ContainerDied","Data":"00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1"} Jul 06 19:35:29.469448 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.469435 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-z45jt" event={"ID":"7ff95b01-52d1-458b-9c11-c6873ef9652b","Type":"ContainerDied","Data":"a7d900d468ae595db38a586cc1f8aaf32b3e7daa6ddd2977f059ac1e97dcc37f"} Jul 06 19:35:29.470649 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.470628 2563 generic.go:356] "Generic (PLEG): container finished" podID="12791a64-c473-4323-8eac-d8e76ddd05e9" containerID="f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a" exitCode=0 Jul 06 19:35:29.470754 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.470685 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" Jul 06 19:35:29.470754 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.470707 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" event={"ID":"12791a64-c473-4323-8eac-d8e76ddd05e9","Type":"ContainerDied","Data":"f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a"} Jul 06 19:35:29.470754 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.470742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-h2cqv" event={"ID":"12791a64-c473-4323-8eac-d8e76ddd05e9","Type":"ContainerDied","Data":"b3a83fa7a43fbc7edeafe57a17c1fd8bc8b008a59ee84b9cc40c1603051d97b0"} Jul 06 19:35:29.479031 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.478980 2563 scope.go:117] "RemoveContainer" containerID="53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb" Jul 06 19:35:29.479400 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:35:29.479287 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb\": container with ID starting with 53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb not found: ID does not exist" containerID="53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb" Jul 06 19:35:29.479400 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.479324 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb"} err="failed to get container status \"53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb\": rpc error: code = NotFound desc = could not find container \"53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb\": container with ID starting with 53487ad1c388ba6ac6b322b6adea1de25a67d52f49ef59da4c87c124913806bb not found: ID does not exist" Jul 06 19:35:29.479400 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.479348 2563 scope.go:117] "RemoveContainer" containerID="00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1" Jul 06 19:35:29.488124 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.488108 2563 scope.go:117] "RemoveContainer" containerID="00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1" Jul 06 19:35:29.488478 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:35:29.488460 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1\": container with ID starting with 00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1 not found: ID does not exist" containerID="00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1" Jul 06 19:35:29.488548 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.488485 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1"} err="failed to get container status \"00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1\": rpc error: code = NotFound desc = could not find container \"00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1\": container with ID starting with 00ad3d78525a2b5eed01ced44a2a15f150a48b89b6cb3c652c7a94cf0092f3f1 not found: ID does not exist" Jul 06 19:35:29.488548 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.488500 2563 scope.go:117] "RemoveContainer" containerID="f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a" Jul 06 19:35:29.495846 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.495830 2563 scope.go:117] "RemoveContainer" containerID="f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a" Jul 06 19:35:29.496080 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:35:29.496065 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a\": container with ID starting with f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a not found: ID does not exist" containerID="f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a" Jul 06 19:35:29.496129 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.496084 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a"} err="failed to get container status \"f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a\": rpc error: code = NotFound desc = could not find container \"f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a\": container with ID starting with f83ed937522935debdd5687b0cdf5019766e83390ad38840a274eed71af3144a not found: ID does not exist" Jul 06 19:35:29.505095 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.505077 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z45jt"] Jul 06 19:35:29.509330 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.509311 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-z45jt"] Jul 06 19:35:29.524577 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.524554 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6cdd7cff48-mpvc4"] Jul 06 19:35:29.527484 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.527463 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6cdd7cff48-mpvc4"] Jul 06 19:35:29.542102 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.542066 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h2cqv"] Jul 06 19:35:29.550936 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:29.550913 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-h2cqv"] Jul 06 19:35:30.811118 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:30.811081 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12791a64-c473-4323-8eac-d8e76ddd05e9" path="/var/lib/kubelet/pods/12791a64-c473-4323-8eac-d8e76ddd05e9/volumes" Jul 06 19:35:30.811541 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:30.811419 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ff95b01-52d1-458b-9c11-c6873ef9652b" path="/var/lib/kubelet/pods/7ff95b01-52d1-458b-9c11-c6873ef9652b/volumes" Jul 06 19:35:30.811687 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:35:30.811675 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afaec6b7-b87a-4279-8afc-0b3b7a4eee32" path="/var/lib/kubelet/pods/afaec6b7-b87a-4279-8afc-0b3b7a4eee32/volumes" Jul 06 19:36:46.003868 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.003838 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7"] Jul 06 19:36:46.004290 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004201 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ff95b01-52d1-458b-9c11-c6873ef9652b" containerName="authorino" Jul 06 19:36:46.004290 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004214 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ff95b01-52d1-458b-9c11-c6873ef9652b" containerName="authorino" Jul 06 19:36:46.004290 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004222 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afaec6b7-b87a-4279-8afc-0b3b7a4eee32" containerName="authorino" Jul 06 19:36:46.004290 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004227 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="afaec6b7-b87a-4279-8afc-0b3b7a4eee32" containerName="authorino" Jul 06 19:36:46.004290 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004239 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12791a64-c473-4323-8eac-d8e76ddd05e9" containerName="authorino" Jul 06 19:36:46.004290 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004245 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="12791a64-c473-4323-8eac-d8e76ddd05e9" containerName="authorino" Jul 06 19:36:46.004556 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004306 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ff95b01-52d1-458b-9c11-c6873ef9652b" containerName="authorino" Jul 06 19:36:46.004556 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004314 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="12791a64-c473-4323-8eac-d8e76ddd05e9" containerName="authorino" Jul 06 19:36:46.004556 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.004323 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="afaec6b7-b87a-4279-8afc-0b3b7a4eee32" containerName="authorino" Jul 06 19:36:46.007402 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.007384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.012449 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.012429 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tbnnk\"" Jul 06 19:36:46.012581 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.012433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 19:36:46.012581 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.012480 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 19:36:46.012873 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.012856 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 19:36:46.024782 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.024761 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7"] Jul 06 19:36:46.130580 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.130548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.130739 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.130596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjpd\" (UniqueName: \"kubernetes.io/projected/6c569d59-03b6-483c-952f-e04c56c21dcc-kube-api-access-fsjpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.130739 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.130673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.130739 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.130697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c569d59-03b6-483c-952f-e04c56c21dcc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.130739 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.130720 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.130739 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.130739 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.231985 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.231957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232137 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.231998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c569d59-03b6-483c-952f-e04c56c21dcc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232137 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.232116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232257 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.232155 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232257 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.232182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232257 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.232240 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjpd\" (UniqueName: \"kubernetes.io/projected/6c569d59-03b6-483c-952f-e04c56c21dcc-kube-api-access-fsjpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.232489 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232519 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.232506 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.232701 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.232586 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.234233 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.234214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6c569d59-03b6-483c-952f-e04c56c21dcc-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.234387 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.234371 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c569d59-03b6-483c-952f-e04c56c21dcc-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.239792 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.239767 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjpd\" (UniqueName: \"kubernetes.io/projected/6c569d59-03b6-483c-952f-e04c56c21dcc-kube-api-access-fsjpd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4xsj7\" (UID: \"6c569d59-03b6-483c-952f-e04c56c21dcc\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.317826 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.317770 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:46.451313 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.451289 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7"] Jul 06 19:36:46.453218 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:36:46.453178 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c569d59_03b6_483c_952f_e04c56c21dcc.slice/crio-f58ca85fcc645121ff5352797dad8bde128c56885563ab503348ed4ba8d3a9ea WatchSource:0}: Error finding container f58ca85fcc645121ff5352797dad8bde128c56885563ab503348ed4ba8d3a9ea: Status 404 returned error can't find the container with id f58ca85fcc645121ff5352797dad8bde128c56885563ab503348ed4ba8d3a9ea Jul 06 19:36:46.454544 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.454526 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:36:46.861584 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:46.861544 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" event={"ID":"6c569d59-03b6-483c-952f-e04c56c21dcc","Type":"ContainerStarted","Data":"f58ca85fcc645121ff5352797dad8bde128c56885563ab503348ed4ba8d3a9ea"} Jul 06 19:36:47.867971 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:47.867923 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" event={"ID":"6c569d59-03b6-483c-952f-e04c56c21dcc","Type":"ContainerStarted","Data":"1554734f886d5bea04513fe1e01de028180605233e96f9be68405c2094aa207b"} Jul 06 19:36:47.887362 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:47.887315 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" podStartSLOduration=1.791006355 podStartE2EDuration="2.887300106s" totalImagesPullingTime="1.096293751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:36:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:36:47.885963995 +0000 UTC m=+659.643133480" watchObservedRunningTime="2026-07-06 19:36:47.887300106 +0000 UTC m=+659.644469593" Jul 06 19:36:56.318267 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:56.318211 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:56.318714 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:56.318301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:56.330499 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:56.330475 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:36:56.923649 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:36:56.923622 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4xsj7" Jul 06 19:37:05.908383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:05.908354 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq"] Jul 06 19:37:05.911959 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:05.911941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:05.914951 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:37:05.914922 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" podUID="3bf0211a-b056-4b4c-935d-69ba6d89e29e" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:05.915047 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:37:05.915007 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-136-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-136-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" type="*v1.Secret" Jul 06 19:37:05.944992 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:05.944962 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq"] Jul 06 19:37:06.009527 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.009497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.009702 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.009541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5p9f\" (UniqueName: \"kubernetes.io/projected/3bf0211a-b056-4b4c-935d-69ba6d89e29e-kube-api-access-g5p9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.009702 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.009626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.009702 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.009665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.009702 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.009686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.009874 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.009768 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf0211a-b056-4b4c-935d-69ba6d89e29e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.110853 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.110812 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.110853 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.110858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.111071 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.110883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.111071 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.110926 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf0211a-b056-4b4c-935d-69ba6d89e29e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.111071 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.110970 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.111071 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.111014 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5p9f\" (UniqueName: \"kubernetes.io/projected/3bf0211a-b056-4b4c-935d-69ba6d89e29e-kube-api-access-g5p9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.111383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.111349 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.111383 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.111376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.111530 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.111409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.113073 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.113051 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3bf0211a-b056-4b4c-935d-69ba6d89e29e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.127400 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.127374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5p9f\" (UniqueName: \"kubernetes.io/projected/3bf0211a-b056-4b4c-935d-69ba6d89e29e-kube-api-access-g5p9f\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.776953 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.776926 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 06 19:37:06.783775 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.783746 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bf0211a-b056-4b4c-935d-69ba6d89e29e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq\" (UID: \"3bf0211a-b056-4b4c-935d-69ba6d89e29e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.821256 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.821217 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:06.956504 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.956473 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq"] Jul 06 19:37:06.956916 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:37:06.956896 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf0211a_b056_4b4c_935d_69ba6d89e29e.slice/crio-367490e3c293336207c97eace9ac1c9841d2f1377aae5cce066430bdf990efdc WatchSource:0}: Error finding container 367490e3c293336207c97eace9ac1c9841d2f1377aae5cce066430bdf990efdc: Status 404 returned error can't find the container with id 367490e3c293336207c97eace9ac1c9841d2f1377aae5cce066430bdf990efdc Jul 06 19:37:06.964121 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:06.964091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" event={"ID":"3bf0211a-b056-4b4c-935d-69ba6d89e29e","Type":"ContainerStarted","Data":"367490e3c293336207c97eace9ac1c9841d2f1377aae5cce066430bdf990efdc"} Jul 06 19:37:07.972395 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:07.972364 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" event={"ID":"3bf0211a-b056-4b4c-935d-69ba6d89e29e","Type":"ContainerStarted","Data":"8d5c0b04504b9b97bac0e86f92ce672b33ee2b56e211dc9debe2a96c62cd8d0d"} Jul 06 19:37:07.992486 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:07.992432 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" podStartSLOduration=2.802256877 podStartE2EDuration="2.992412269s" totalImagesPullingTime="190.155392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:37:07.989874699 +0000 UTC m=+679.747044186" watchObservedRunningTime="2026-07-06 19:37:07.992412269 +0000 UTC m=+679.749581758" Jul 06 19:37:16.821663 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:16.821624 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:16.822038 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:16.821689 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:16.833656 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:16.833634 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:37:17.030593 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:37:17.030569 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq" Jul 06 19:38:32.844093 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:32.844066 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bc866d97-gv8bp"] Jul 06 19:38:32.847657 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:32.847635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:32.856208 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:32.856187 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bc866d97-gv8bp"] Jul 06 19:38:32.914200 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:32.914171 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9hjn\" (UniqueName: \"kubernetes.io/projected/83af3079-bfe6-43f9-bb96-a9ccb2f936e1-kube-api-access-k9hjn\") pod \"authorino-6bc866d97-gv8bp\" (UID: \"83af3079-bfe6-43f9-bb96-a9ccb2f936e1\") " pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:32.914323 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:32.914222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83af3079-bfe6-43f9-bb96-a9ccb2f936e1-tls-cert\") pod \"authorino-6bc866d97-gv8bp\" (UID: \"83af3079-bfe6-43f9-bb96-a9ccb2f936e1\") " pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:33.015661 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:33.015632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9hjn\" (UniqueName: \"kubernetes.io/projected/83af3079-bfe6-43f9-bb96-a9ccb2f936e1-kube-api-access-k9hjn\") pod \"authorino-6bc866d97-gv8bp\" (UID: \"83af3079-bfe6-43f9-bb96-a9ccb2f936e1\") " pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:33.015789 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:33.015676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83af3079-bfe6-43f9-bb96-a9ccb2f936e1-tls-cert\") pod \"authorino-6bc866d97-gv8bp\" (UID: \"83af3079-bfe6-43f9-bb96-a9ccb2f936e1\") " pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:33.018224 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:33.018201 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/83af3079-bfe6-43f9-bb96-a9ccb2f936e1-tls-cert\") pod \"authorino-6bc866d97-gv8bp\" (UID: \"83af3079-bfe6-43f9-bb96-a9ccb2f936e1\") " pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:33.025340 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:33.025312 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9hjn\" (UniqueName: \"kubernetes.io/projected/83af3079-bfe6-43f9-bb96-a9ccb2f936e1-kube-api-access-k9hjn\") pod \"authorino-6bc866d97-gv8bp\" (UID: \"83af3079-bfe6-43f9-bb96-a9ccb2f936e1\") " pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:33.157307 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:33.157283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bc866d97-gv8bp" Jul 06 19:38:33.340452 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:33.340424 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bc866d97-gv8bp"] Jul 06 19:38:33.342249 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:38:33.342218 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83af3079_bfe6_43f9_bb96_a9ccb2f936e1.slice/crio-6897c04bba1dd3c7a4e01d25cf1aaf2cddcf76a12256c4728e20497ab3ebd085 WatchSource:0}: Error finding container 6897c04bba1dd3c7a4e01d25cf1aaf2cddcf76a12256c4728e20497ab3ebd085: Status 404 returned error can't find the container with id 6897c04bba1dd3c7a4e01d25cf1aaf2cddcf76a12256c4728e20497ab3ebd085 Jul 06 19:38:33.412602 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:33.412533 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc866d97-gv8bp" event={"ID":"83af3079-bfe6-43f9-bb96-a9ccb2f936e1","Type":"ContainerStarted","Data":"6897c04bba1dd3c7a4e01d25cf1aaf2cddcf76a12256c4728e20497ab3ebd085"} Jul 06 19:38:34.419830 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.419785 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bc866d97-gv8bp" event={"ID":"83af3079-bfe6-43f9-bb96-a9ccb2f936e1","Type":"ContainerStarted","Data":"ef1d87eef83eac1ac616be387068427dd729cec97a2d651b1578ea2f48d87fc1"} Jul 06 19:38:34.474061 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.473985 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bc866d97-gv8bp" podStartSLOduration=2.043082756 podStartE2EDuration="2.473961911s" totalImagesPullingTime="430.879155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:38:34.470386411 +0000 UTC m=+766.227555902" watchObservedRunningTime="2026-07-06 19:38:34.473961911 +0000 UTC m=+766.231131401" Jul 06 19:38:34.547901 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.547869 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-88845dfb-76s44"] Jul 06 19:38:34.548090 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.548051 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-88845dfb-76s44" podUID="1d13e760-6c7a-4fde-99ee-dc87dba411f3" containerName="authorino" containerID="cri-o://f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00" gracePeriod=30 Jul 06 19:38:34.801755 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.801731 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:38:34.933650 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.933616 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d13e760-6c7a-4fde-99ee-dc87dba411f3-tls-cert\") pod \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " Jul 06 19:38:34.933843 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.933667 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5n7b\" (UniqueName: \"kubernetes.io/projected/1d13e760-6c7a-4fde-99ee-dc87dba411f3-kube-api-access-z5n7b\") pod \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\" (UID: \"1d13e760-6c7a-4fde-99ee-dc87dba411f3\") " Jul 06 19:38:34.935678 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.935649 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d13e760-6c7a-4fde-99ee-dc87dba411f3-kube-api-access-z5n7b" (OuterVolumeSpecName: "kube-api-access-z5n7b") pod "1d13e760-6c7a-4fde-99ee-dc87dba411f3" (UID: "1d13e760-6c7a-4fde-99ee-dc87dba411f3"). InnerVolumeSpecName "kube-api-access-z5n7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:38:34.944133 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:34.944104 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d13e760-6c7a-4fde-99ee-dc87dba411f3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1d13e760-6c7a-4fde-99ee-dc87dba411f3" (UID: "1d13e760-6c7a-4fde-99ee-dc87dba411f3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:38:35.034732 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.034696 2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d13e760-6c7a-4fde-99ee-dc87dba411f3-tls-cert\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:38:35.034929 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.034913 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5n7b\" (UniqueName: \"kubernetes.io/projected/1d13e760-6c7a-4fde-99ee-dc87dba411f3-kube-api-access-z5n7b\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:38:35.428344 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.428307 2563 generic.go:356] "Generic (PLEG): container finished" podID="1d13e760-6c7a-4fde-99ee-dc87dba411f3" containerID="f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00" exitCode=0 Jul 06 19:38:35.428777 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.428362 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-88845dfb-76s44" Jul 06 19:38:35.428777 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.428393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88845dfb-76s44" event={"ID":"1d13e760-6c7a-4fde-99ee-dc87dba411f3","Type":"ContainerDied","Data":"f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00"} Jul 06 19:38:35.428777 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.428432 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-88845dfb-76s44" event={"ID":"1d13e760-6c7a-4fde-99ee-dc87dba411f3","Type":"ContainerDied","Data":"a5e18ebc9636cbec97067d33fce63be3df882063cfbe8dd1d9fc7ef94eb3fb02"} Jul 06 19:38:35.428777 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.428448 2563 scope.go:117] "RemoveContainer" containerID="f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00" Jul 06 19:38:35.437191 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.437170 2563 scope.go:117] "RemoveContainer" containerID="f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00" Jul 06 19:38:35.437465 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:38:35.437443 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00\": container with ID starting with f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00 not found: ID does not exist" containerID="f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00" Jul 06 19:38:35.437537 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.437472 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00"} err="failed to get container status \"f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00\": rpc error: code = NotFound desc = could not find container \"f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00\": container with ID starting with f8887cdbe565e5dbb1a192258ed07e6d9b389a771377717bcd0539d2e33eae00 not found: ID does not exist" Jul 06 19:38:35.457829 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.457802 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-88845dfb-76s44"] Jul 06 19:38:35.465577 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:35.465553 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-88845dfb-76s44"] Jul 06 19:38:36.810989 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:38:36.810950 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d13e760-6c7a-4fde-99ee-dc87dba411f3" path="/var/lib/kubelet/pods/1d13e760-6c7a-4fde-99ee-dc87dba411f3/volumes" Jul 06 19:40:12.919763 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:12.919683 2563 generic.go:356] "Generic (PLEG): container finished" podID="207527af-32a5-414c-9b81-fd61746ac4a6" containerID="8547c8bd1b4d41d9016a4e75771e077e81547af9b7584e9bc71214f215bea91c" exitCode=1 Jul 06 19:40:12.920190 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:12.919755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" event={"ID":"207527af-32a5-414c-9b81-fd61746ac4a6","Type":"ContainerDied","Data":"8547c8bd1b4d41d9016a4e75771e077e81547af9b7584e9bc71214f215bea91c"} Jul 06 19:40:12.920190 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:12.920128 2563 scope.go:117] "RemoveContainer" containerID="8547c8bd1b4d41d9016a4e75771e077e81547af9b7584e9bc71214f215bea91c" Jul 06 19:40:12.921463 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:12.921444 2563 generic.go:356] "Generic (PLEG): container finished" podID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerID="75dc04498c179715a0ceb96e844930e432ff11b6e9a45da0edadeed9f249deaf" exitCode=0 Jul 06 19:40:12.921548 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:12.921485 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerDied","Data":"75dc04498c179715a0ceb96e844930e432ff11b6e9a45da0edadeed9f249deaf"} Jul 06 19:40:12.921728 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:12.921714 2563 scope.go:117] "RemoveContainer" containerID="75dc04498c179715a0ceb96e844930e432ff11b6e9a45da0edadeed9f249deaf" Jul 06 19:40:13.106876 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:13.106831 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:40:13.928720 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:13.928690 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerStarted","Data":"ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8"} Jul 06 19:40:13.929182 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:13.928771 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:40:13.930488 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:13.930468 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" event={"ID":"207527af-32a5-414c-9b81-fd61746ac4a6","Type":"ContainerStarted","Data":"d037f4e47a64cd479cc6510310114b3318191afb2f90b573ba555ea376441f6f"} Jul 06 19:40:13.930639 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:13.930626 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:40:18.438439 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:40:18.438398 2563 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-35.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 06 19:40:24.937094 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:24.937062 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c85d89ddf-g42qb" Jul 06 19:40:24.937471 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:40:24.937130 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:40:43.121303 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:40:43.121208 2563 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-35.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 06 19:40:53.121676 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:40:53.121635 2563 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-35.ec2.internal?timeout=10s\": context deadline exceeded" Jul 06 19:41:03.122014 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:41:03.121977 2563 controller.go:195] "Failed to update lease" err="Put \"https://ac62e67e410bc444e977b99541dde199-2f2af20a0dc725e5.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-136-35.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Jul 06 19:41:30.335042 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:30.335010 2563 generic.go:356] "Generic (PLEG): container finished" podID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerID="ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8" exitCode=0 Jul 06 19:41:30.335500 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:30.335069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerDied","Data":"ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8"} Jul 06 19:41:30.335500 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:30.335118 2563 scope.go:117] "RemoveContainer" containerID="75dc04498c179715a0ceb96e844930e432ff11b6e9a45da0edadeed9f249deaf" Jul 06 19:41:30.335500 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:30.335422 2563 scope.go:117] "RemoveContainer" containerID="ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8" Jul 06 19:41:30.335670 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:41:30.335603 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-86878c769f-rnlf8_kuadrant-system(ce5c0bed-3407-4c72-b75b-6e0b97c6f506)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" Jul 06 19:41:34.935947 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:34.935916 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:41:34.936395 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:34.936273 2563 scope.go:117] "RemoveContainer" containerID="ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8" Jul 06 19:41:34.936494 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:41:34.936470 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kuadrant-operator-controller-manager-86878c769f-rnlf8_kuadrant-system(ce5c0bed-3407-4c72-b75b-6e0b97c6f506)\"" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" Jul 06 19:41:41.648995 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:41.648961 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:41:41.649402 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:41.649344 2563 scope.go:117] "RemoveContainer" containerID="ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8" Jul 06 19:41:42.398695 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:42.398663 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerStarted","Data":"88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596"} Jul 06 19:41:42.398893 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:42.398874 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:41:53.405511 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:41:53.405479 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:46:59.387915 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:46:59.387837 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8"] Jul 06 19:46:59.390083 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:46:59.388079 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" containerID="cri-o://88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596" gracePeriod=10 Jul 06 19:47:01.443674 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:01.443647 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:47:01.524432 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:01.524346 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-extensions-socket-volume\") pod \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " Jul 06 19:47:01.524432 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:01.524429 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hf8mz\" (UniqueName: \"kubernetes.io/projected/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-kube-api-access-hf8mz\") pod \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\" (UID: \"ce5c0bed-3407-4c72-b75b-6e0b97c6f506\") " Jul 06 19:47:01.524722 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:01.524697 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ce5c0bed-3407-4c72-b75b-6e0b97c6f506" (UID: "ce5c0bed-3407-4c72-b75b-6e0b97c6f506"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:47:01.526364 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:01.526342 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-kube-api-access-hf8mz" (OuterVolumeSpecName: "kube-api-access-hf8mz") pod "ce5c0bed-3407-4c72-b75b-6e0b97c6f506" (UID: "ce5c0bed-3407-4c72-b75b-6e0b97c6f506"). InnerVolumeSpecName "kube-api-access-hf8mz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:47:01.625746 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:01.625707 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-extensions-socket-volume\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:47:01.625746 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:01.625739 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hf8mz\" (UniqueName: \"kubernetes.io/projected/ce5c0bed-3407-4c72-b75b-6e0b97c6f506-kube-api-access-hf8mz\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 19:47:02.077249 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.077212 2563 generic.go:356] "Generic (PLEG): container finished" podID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerID="88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596" exitCode=0 Jul 06 19:47:02.077418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.077257 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" Jul 06 19:47:02.077418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.077267 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerDied","Data":"88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596"} Jul 06 19:47:02.077418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.077310 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8" event={"ID":"ce5c0bed-3407-4c72-b75b-6e0b97c6f506","Type":"ContainerDied","Data":"39e8a21038299ca9340336cced14ffed33b78183b1b0de7fc9bd7dffe0353d51"} Jul 06 19:47:02.077418 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.077332 2563 scope.go:117] "RemoveContainer" containerID="88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596" Jul 06 19:47:02.087518 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.087441 2563 scope.go:117] "RemoveContainer" containerID="ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8" Jul 06 19:47:02.096235 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.096066 2563 scope.go:117] "RemoveContainer" containerID="88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596" Jul 06 19:47:02.096456 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:47:02.096422 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596\": container with ID starting with 88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596 not found: ID does not exist" containerID="88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596" Jul 06 19:47:02.096563 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.096461 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596"} err="failed to get container status \"88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596\": rpc error: code = NotFound desc = could not find container \"88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596\": container with ID starting with 88f559738ebaff792967c2a2eb3bf8abd64d83c2acdeb2a3caa281604fbe7596 not found: ID does not exist" Jul 06 19:47:02.096563 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.096479 2563 scope.go:117] "RemoveContainer" containerID="ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8" Jul 06 19:47:02.096743 ip-10-0-136-35 kubenswrapper[2563]: E0706 19:47:02.096727 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8\": container with ID starting with ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8 not found: ID does not exist" containerID="ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8" Jul 06 19:47:02.096790 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.096748 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8"} err="failed to get container status \"ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8\": rpc error: code = NotFound desc = could not find container \"ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8\": container with ID starting with ac10e01273b2b2af5464a2ff68b9b683eb475ea6c553062e68a6fb28a2fec2c8 not found: ID does not exist" Jul 06 19:47:02.097607 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.097589 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8"] Jul 06 19:47:02.101861 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.101841 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rnlf8"] Jul 06 19:47:02.811408 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:47:02.811372 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" path="/var/lib/kubelet/pods/ce5c0bed-3407-4c72-b75b-6e0b97c6f506/volumes" Jul 06 19:48:00.718826 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.718791 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8"] Jul 06 19:48:00.719251 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719193 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 19:48:00.719251 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719206 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 19:48:00.719251 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719227 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d13e760-6c7a-4fde-99ee-dc87dba411f3" containerName="authorino" Jul 06 19:48:00.719251 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719233 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d13e760-6c7a-4fde-99ee-dc87dba411f3" containerName="authorino" Jul 06 19:48:00.719251 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719252 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 19:48:00.719436 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719260 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 19:48:00.719436 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719329 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 19:48:00.719436 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719340 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 19:48:00.719436 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.719347 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d13e760-6c7a-4fde-99ee-dc87dba411f3" containerName="authorino" Jul 06 19:48:00.723135 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.723119 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:00.725465 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.725443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rqz87\"" Jul 06 19:48:00.732439 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.732413 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8"] Jul 06 19:48:00.799681 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.799645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cssdh\" (UniqueName: \"kubernetes.io/projected/688375cd-3293-4439-aee4-d2e4ddb8e7ef-kube-api-access-cssdh\") pod \"kuadrant-operator-controller-manager-86878c769f-bzqx8\" (UID: \"688375cd-3293-4439-aee4-d2e4ddb8e7ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:00.799681 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.799684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/688375cd-3293-4439-aee4-d2e4ddb8e7ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bzqx8\" (UID: \"688375cd-3293-4439-aee4-d2e4ddb8e7ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:00.900134 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.900096 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cssdh\" (UniqueName: \"kubernetes.io/projected/688375cd-3293-4439-aee4-d2e4ddb8e7ef-kube-api-access-cssdh\") pod \"kuadrant-operator-controller-manager-86878c769f-bzqx8\" (UID: \"688375cd-3293-4439-aee4-d2e4ddb8e7ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:00.900134 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.900138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/688375cd-3293-4439-aee4-d2e4ddb8e7ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bzqx8\" (UID: \"688375cd-3293-4439-aee4-d2e4ddb8e7ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:00.900585 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.900564 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/688375cd-3293-4439-aee4-d2e4ddb8e7ef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bzqx8\" (UID: \"688375cd-3293-4439-aee4-d2e4ddb8e7ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:00.908554 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:00.908524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cssdh\" (UniqueName: \"kubernetes.io/projected/688375cd-3293-4439-aee4-d2e4ddb8e7ef-kube-api-access-cssdh\") pod \"kuadrant-operator-controller-manager-86878c769f-bzqx8\" (UID: \"688375cd-3293-4439-aee4-d2e4ddb8e7ef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:01.033657 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:01.033564 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:01.172428 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:01.172344 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8"] Jul 06 19:48:01.175487 ip-10-0-136-35 kubenswrapper[2563]: W0706 19:48:01.175458 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688375cd_3293_4439_aee4_d2e4ddb8e7ef.slice/crio-14475a292766a0134fba82d59cdb7d85552e7405851ab9d6253a42d11ae05c4d WatchSource:0}: Error finding container 14475a292766a0134fba82d59cdb7d85552e7405851ab9d6253a42d11ae05c4d: Status 404 returned error can't find the container with id 14475a292766a0134fba82d59cdb7d85552e7405851ab9d6253a42d11ae05c4d Jul 06 19:48:01.387205 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:01.387161 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" event={"ID":"688375cd-3293-4439-aee4-d2e4ddb8e7ef","Type":"ContainerStarted","Data":"8d16c168e742cac6de6a29637b42eedb0dc7b1f6631f48b071f0c682711dd493"} Jul 06 19:48:01.387359 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:01.387223 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" event={"ID":"688375cd-3293-4439-aee4-d2e4ddb8e7ef","Type":"ContainerStarted","Data":"14475a292766a0134fba82d59cdb7d85552e7405851ab9d6253a42d11ae05c4d"} Jul 06 19:48:01.387359 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:01.387249 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 19:48:01.411744 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:01.411697 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" podStartSLOduration=1.411682579 podStartE2EDuration="1.411682579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:48:01.411358956 +0000 UTC m=+1333.168528440" watchObservedRunningTime="2026-07-06 19:48:01.411682579 +0000 UTC m=+1333.168852066" Jul 06 19:48:12.394971 ip-10-0-136-35 kubenswrapper[2563]: I0706 19:48:12.394936 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bzqx8" Jul 06 20:06:06.742247 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.742206 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c"] Jul 06 20:06:06.742863 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.742842 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 20:06:06.742976 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.742866 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 20:06:06.743028 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.742983 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce5c0bed-3407-4c72-b75b-6e0b97c6f506" containerName="manager" Jul 06 20:06:06.746137 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.746119 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:06.749793 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.749770 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"kube-root-ca.crt\"" Jul 06 20:06:06.750278 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.750257 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"default-dockercfg-mmxl9\"" Jul 06 20:06:06.750377 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.750258 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"sub-test-model-96f4cb-kserve-self-signed-certs\"" Jul 06 20:06:06.750377 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.750269 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-96f4cb\"/\"openshift-service-ca.crt\"" Jul 06 20:06:06.759463 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.759438 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c"] Jul 06 20:06:06.908453 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.908414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-model-cache\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:06.908625 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.908467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tls-certs\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:06.908625 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.908562 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxxnv\" (UniqueName: \"kubernetes.io/projected/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-kube-api-access-rxxnv\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:06.908704 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.908626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-home\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:06.908704 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.908650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tmp-dir\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:06.908704 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:06.908669 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-dshm\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.009717 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.009629 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-dshm\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.009717 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.009699 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-model-cache\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.009916 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.009731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tls-certs\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.009916 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.009759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxxnv\" (UniqueName: \"kubernetes.io/projected/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-kube-api-access-rxxnv\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.009916 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.009816 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-home\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.009916 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.009838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tmp-dir\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.010176 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.010137 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-model-cache\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.010327 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.010214 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-home\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.010423 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.010235 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tmp-dir\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.011855 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.011835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-dshm\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.012118 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.012102 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tls-certs\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.019275 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.019251 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxxnv\" (UniqueName: \"kubernetes.io/projected/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-kube-api-access-rxxnv\") pod \"sub-test-model-96f4cb-kserve-7897f4d887-bfv5c\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.055634 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.055602 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:07.194477 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:07.194447 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c"] Jul 06 20:06:07.196345 ip-10-0-136-35 kubenswrapper[2563]: W0706 20:06:07.196316 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f823d5b_1ee7_43b6_b0ea_320e42c46b08.slice/crio-6c07b5f1a0b682baaf14f07a6bd0a544f7d4022486b650a2d7e5b9272a588efb WatchSource:0}: Error finding container 6c07b5f1a0b682baaf14f07a6bd0a544f7d4022486b650a2d7e5b9272a588efb: Status 404 returned error can't find the container with id 6c07b5f1a0b682baaf14f07a6bd0a544f7d4022486b650a2d7e5b9272a588efb Jul 06 20:06:08.143258 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:08.143209 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" event={"ID":"5f823d5b-1ee7-43b6-b0ea-320e42c46b08","Type":"ContainerStarted","Data":"a4f4bccd8851e896e68e4d2da5187e59f4488616ec6c2b2337218badc86559bb"} Jul 06 20:06:08.143258 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:08.143265 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" event={"ID":"5f823d5b-1ee7-43b6-b0ea-320e42c46b08","Type":"ContainerStarted","Data":"6c07b5f1a0b682baaf14f07a6bd0a544f7d4022486b650a2d7e5b9272a588efb"} Jul 06 20:06:08.173257 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:08.173207 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" podStartSLOduration=2.173190952 podStartE2EDuration="2.173190952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:06:08.172677392 +0000 UTC m=+2419.929846888" watchObservedRunningTime="2026-07-06 20:06:08.173190952 +0000 UTC m=+2419.930360452" Jul 06 20:06:17.056056 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:17.056010 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:17.056056 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:17.056064 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:17.068156 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:17.068121 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:06:17.203485 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:06:17.203457 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:07:44.543556 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:44.543481 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c"] Jul 06 20:07:59.563266 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.563211 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" podUID="5f823d5b-1ee7-43b6-b0ea-320e42c46b08" containerName="main" containerID="cri-o://a4f4bccd8851e896e68e4d2da5187e59f4488616ec6c2b2337218badc86559bb" gracePeriod=45 Jul 06 20:07:59.742697 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.742664 2563 generic.go:356] "Generic (PLEG): container finished" podID="5f823d5b-1ee7-43b6-b0ea-320e42c46b08" containerID="a4f4bccd8851e896e68e4d2da5187e59f4488616ec6c2b2337218badc86559bb" exitCode=0 Jul 06 20:07:59.742835 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.742720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" event={"ID":"5f823d5b-1ee7-43b6-b0ea-320e42c46b08","Type":"ContainerDied","Data":"a4f4bccd8851e896e68e4d2da5187e59f4488616ec6c2b2337218badc86559bb"} Jul 06 20:07:59.823216 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.823160 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:07:59.904489 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904454 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-model-cache\") pod \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " Jul 06 20:07:59.904489 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904491 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-dshm\") pod \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " Jul 06 20:07:59.904732 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904524 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tls-certs\") pod \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " Jul 06 20:07:59.904732 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904561 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tmp-dir\") pod \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " Jul 06 20:07:59.904732 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904609 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-home\") pod \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " Jul 06 20:07:59.904732 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904657 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxxnv\" (UniqueName: \"kubernetes.io/projected/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-kube-api-access-rxxnv\") pod \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\" (UID: \"5f823d5b-1ee7-43b6-b0ea-320e42c46b08\") " Jul 06 20:07:59.904935 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904798 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f823d5b-1ee7-43b6-b0ea-320e42c46b08" (UID: "5f823d5b-1ee7-43b6-b0ea-320e42c46b08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:07:59.904935 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904895 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f823d5b-1ee7-43b6-b0ea-320e42c46b08" (UID: "5f823d5b-1ee7-43b6-b0ea-320e42c46b08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:07:59.905047 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.904934 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-home" (OuterVolumeSpecName: "home") pod "5f823d5b-1ee7-43b6-b0ea-320e42c46b08" (UID: "5f823d5b-1ee7-43b6-b0ea-320e42c46b08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:07:59.905047 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.905032 2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tmp-dir\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 20:07:59.905141 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.905048 2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-home\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 20:07:59.905141 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.905057 2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-model-cache\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 20:07:59.906916 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.906887 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f823d5b-1ee7-43b6-b0ea-320e42c46b08" (UID: "5f823d5b-1ee7-43b6-b0ea-320e42c46b08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:07:59.906916 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.906896 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-kube-api-access-rxxnv" (OuterVolumeSpecName: "kube-api-access-rxxnv") pod "5f823d5b-1ee7-43b6-b0ea-320e42c46b08" (UID: "5f823d5b-1ee7-43b6-b0ea-320e42c46b08"). InnerVolumeSpecName "kube-api-access-rxxnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:07:59.906916 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:07:59.906893 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-dshm" (OuterVolumeSpecName: "dshm") pod "5f823d5b-1ee7-43b6-b0ea-320e42c46b08" (UID: "5f823d5b-1ee7-43b6-b0ea-320e42c46b08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:08:00.006421 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.006384 2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-dshm\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 20:08:00.006421 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.006415 2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-tls-certs\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 20:08:00.006421 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.006427 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxxnv\" (UniqueName: \"kubernetes.io/projected/5f823d5b-1ee7-43b6-b0ea-320e42c46b08-kube-api-access-rxxnv\") on node \"ip-10-0-136-35.ec2.internal\" DevicePath \"\"" Jul 06 20:08:00.749326 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.749286 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" event={"ID":"5f823d5b-1ee7-43b6-b0ea-320e42c46b08","Type":"ContainerDied","Data":"6c07b5f1a0b682baaf14f07a6bd0a544f7d4022486b650a2d7e5b9272a588efb"} Jul 06 20:08:00.749804 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.749338 2563 scope.go:117] "RemoveContainer" containerID="a4f4bccd8851e896e68e4d2da5187e59f4488616ec6c2b2337218badc86559bb" Jul 06 20:08:00.749804 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.749304 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c" Jul 06 20:08:00.772161 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.772122 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c"] Jul 06 20:08:00.776787 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.776762 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-96f4cb/sub-test-model-96f4cb-kserve-7897f4d887-bfv5c"] Jul 06 20:08:00.811273 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:08:00.811241 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f823d5b-1ee7-43b6-b0ea-320e42c46b08" path="/var/lib/kubelet/pods/5f823d5b-1ee7-43b6-b0ea-320e42c46b08/volumes" Jul 06 20:10:26.339796 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:26.339761 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bc866d97-gv8bp_83af3079-bfe6-43f9-bb96-a9ccb2f936e1/authorino/0.log" Jul 06 20:10:32.891692 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:32.891656 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-czm5p_f39faf9b-dfa4-465c-8a09-c8366dbac250/manager/0.log" Jul 06 20:10:32.910331 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:32.910311 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-czm5p_f39faf9b-dfa4-465c-8a09-c8366dbac250/copy-manifests/0.log" Jul 06 20:10:34.084276 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.084246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9_b87fd570-9f27-4cca-9d39-3c634a7755fa/util/0.log" Jul 06 20:10:34.094976 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.094947 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9_b87fd570-9f27-4cca-9d39-3c634a7755fa/pull/0.log" Jul 06 20:10:34.102720 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.102705 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9_b87fd570-9f27-4cca-9d39-3c634a7755fa/extract/0.log" Jul 06 20:10:34.221679 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.221649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt_43a96073-5dd1-426e-9aaa-bac3814e2ff9/util/0.log" Jul 06 20:10:34.229612 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.229588 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt_43a96073-5dd1-426e-9aaa-bac3814e2ff9/pull/0.log" Jul 06 20:10:34.240601 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.240572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt_43a96073-5dd1-426e-9aaa-bac3814e2ff9/extract/0.log" Jul 06 20:10:34.357353 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.357277 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz_9183e870-af6e-42fc-b21e-a3e16f5ff7df/util/0.log" Jul 06 20:10:34.367420 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.367398 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz_9183e870-af6e-42fc-b21e-a3e16f5ff7df/pull/0.log" Jul 06 20:10:34.378855 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.378833 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz_9183e870-af6e-42fc-b21e-a3e16f5ff7df/extract/0.log" Jul 06 20:10:34.496864 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.496837 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw_010a9b62-cd05-44ec-b293-3443cf39e135/util/0.log" Jul 06 20:10:34.512864 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.512838 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw_010a9b62-cd05-44ec-b293-3443cf39e135/pull/0.log" Jul 06 20:10:34.526788 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.526770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw_010a9b62-cd05-44ec-b293-3443cf39e135/extract/0.log" Jul 06 20:10:34.672449 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:34.672421 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bc866d97-gv8bp_83af3079-bfe6-43f9-bb96-a9ccb2f936e1/authorino/0.log" Jul 06 20:10:35.390004 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:35.389973 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bzqx8_688375cd-3293-4439-aee4-d2e4ddb8e7ef/manager/0.log" Jul 06 20:10:36.476523 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:36.476499 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-x6dkx_88261861-6a97-4346-9823-ef81b3f39aac/kube-auth-proxy/0.log" Jul 06 20:10:37.019196 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:37.019133 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b4ccd844f-dqkq6_1b86f430-aedd-43ae-a4fa-9bc4de23dc8b/router/0.log" Jul 06 20:10:37.556388 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:37.556363 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4xsj7_6c569d59-03b6-483c-952f-e04c56c21dcc/main/0.log" Jul 06 20:10:37.800870 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:37.800844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbj8wgq_3bf0211a-b056-4b4c-935d-69ba6d89e29e/main/0.log" Jul 06 20:10:42.363372 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.363287 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7wvf/must-gather-fb4g4"] Jul 06 20:10:42.363762 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.363696 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f823d5b-1ee7-43b6-b0ea-320e42c46b08" containerName="main" Jul 06 20:10:42.363762 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.363710 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f823d5b-1ee7-43b6-b0ea-320e42c46b08" containerName="main" Jul 06 20:10:42.363843 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.363775 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f823d5b-1ee7-43b6-b0ea-320e42c46b08" containerName="main" Jul 06 20:10:42.367015 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.366997 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.370544 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.370520 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7wvf\"/\"openshift-service-ca.crt\"" Jul 06 20:10:42.370669 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.370561 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7wvf\"/\"default-dockercfg-v9qnr\"" Jul 06 20:10:42.370669 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.370621 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7wvf\"/\"kube-root-ca.crt\"" Jul 06 20:10:42.379124 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.379102 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/must-gather-fb4g4"] Jul 06 20:10:42.458171 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.458112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrmzd\" (UniqueName: \"kubernetes.io/projected/b84e805e-85de-4cad-ae47-a10002918830-kube-api-access-hrmzd\") pod \"must-gather-fb4g4\" (UID: \"b84e805e-85de-4cad-ae47-a10002918830\") " pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.458333 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.458187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b84e805e-85de-4cad-ae47-a10002918830-must-gather-output\") pod \"must-gather-fb4g4\" (UID: \"b84e805e-85de-4cad-ae47-a10002918830\") " pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.559050 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.559021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b84e805e-85de-4cad-ae47-a10002918830-must-gather-output\") pod \"must-gather-fb4g4\" (UID: \"b84e805e-85de-4cad-ae47-a10002918830\") " pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.559258 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.559132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrmzd\" (UniqueName: \"kubernetes.io/projected/b84e805e-85de-4cad-ae47-a10002918830-kube-api-access-hrmzd\") pod \"must-gather-fb4g4\" (UID: \"b84e805e-85de-4cad-ae47-a10002918830\") " pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.559379 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.559358 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b84e805e-85de-4cad-ae47-a10002918830-must-gather-output\") pod \"must-gather-fb4g4\" (UID: \"b84e805e-85de-4cad-ae47-a10002918830\") " pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.570278 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.570256 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrmzd\" (UniqueName: \"kubernetes.io/projected/b84e805e-85de-4cad-ae47-a10002918830-kube-api-access-hrmzd\") pod \"must-gather-fb4g4\" (UID: \"b84e805e-85de-4cad-ae47-a10002918830\") " pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.676310 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.676277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/must-gather-fb4g4" Jul 06 20:10:42.811900 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.811867 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/must-gather-fb4g4"] Jul 06 20:10:42.812561 ip-10-0-136-35 kubenswrapper[2563]: W0706 20:10:42.812534 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb84e805e_85de_4cad_ae47_a10002918830.slice/crio-dac21c8f1577351a27654bd2896b3f01e7bcf7156f7133652ae74ae885508301 WatchSource:0}: Error finding container dac21c8f1577351a27654bd2896b3f01e7bcf7156f7133652ae74ae885508301: Status 404 returned error can't find the container with id dac21c8f1577351a27654bd2896b3f01e7bcf7156f7133652ae74ae885508301 Jul 06 20:10:42.814678 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:42.814660 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:10:43.601427 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:43.601393 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/must-gather-fb4g4" event={"ID":"b84e805e-85de-4cad-ae47-a10002918830","Type":"ContainerStarted","Data":"dac21c8f1577351a27654bd2896b3f01e7bcf7156f7133652ae74ae885508301"} Jul 06 20:10:44.607531 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:44.607496 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/must-gather-fb4g4" event={"ID":"b84e805e-85de-4cad-ae47-a10002918830","Type":"ContainerStarted","Data":"92e12622d8a35b69d0de0b931b2de66190ebe0ac4a80d4a3aeb26c57c1cd5d97"} Jul 06 20:10:44.607910 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:44.607544 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/must-gather-fb4g4" event={"ID":"b84e805e-85de-4cad-ae47-a10002918830","Type":"ContainerStarted","Data":"31a86364858a3f9806c9aec040dc7b3ecfd6453779250f6a40db679e586b57ee"} Jul 06 20:10:44.633716 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:44.633646 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n7wvf/must-gather-fb4g4" podStartSLOduration=1.466107349 podStartE2EDuration="2.633624525s" totalImagesPullingTime="1.167517176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:44.631948153 +0000 UTC m=+2696.389117642" watchObservedRunningTime="2026-07-06 20:10:44.633624525 +0000 UTC m=+2696.390794016" Jul 06 20:10:45.800668 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:45.800637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kp5tk_eec73bb3-c96f-429a-9b5f-8a3bd35d6504/global-pull-secret-syncer/0.log" Jul 06 20:10:45.990826 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:45.990798 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b22w2_e99d4fe8-7e7b-446d-a097-e0c8a14f0f07/konnectivity-agent/0.log" Jul 06 20:10:46.123883 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:46.123844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-35.ec2.internal_b47fecc3bc6b998318376f0c89d44556/haproxy/0.log" Jul 06 20:10:50.503211 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.503129 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9_b87fd570-9f27-4cca-9d39-3c634a7755fa/extract/0.log" Jul 06 20:10:50.545466 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.545377 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9_b87fd570-9f27-4cca-9d39-3c634a7755fa/util/0.log" Jul 06 20:10:50.586321 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.586286 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pzkk9_b87fd570-9f27-4cca-9d39-3c634a7755fa/pull/0.log" Jul 06 20:10:50.633116 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.633074 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt_43a96073-5dd1-426e-9aaa-bac3814e2ff9/extract/0.log" Jul 06 20:10:50.665460 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.665428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt_43a96073-5dd1-426e-9aaa-bac3814e2ff9/util/0.log" Jul 06 20:10:50.705025 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.704971 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vnhbt_43a96073-5dd1-426e-9aaa-bac3814e2ff9/pull/0.log" Jul 06 20:10:50.752898 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.752865 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz_9183e870-af6e-42fc-b21e-a3e16f5ff7df/extract/0.log" Jul 06 20:10:50.788079 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.788050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz_9183e870-af6e-42fc-b21e-a3e16f5ff7df/util/0.log" Jul 06 20:10:50.828478 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.828403 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73sb7bz_9183e870-af6e-42fc-b21e-a3e16f5ff7df/pull/0.log" Jul 06 20:10:50.893427 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.893392 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw_010a9b62-cd05-44ec-b293-3443cf39e135/extract/0.log" Jul 06 20:10:50.943312 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.943278 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw_010a9b62-cd05-44ec-b293-3443cf39e135/util/0.log" Jul 06 20:10:50.986072 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:50.986031 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ktrjw_010a9b62-cd05-44ec-b293-3443cf39e135/pull/0.log" Jul 06 20:10:51.373021 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:51.372984 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bc866d97-gv8bp_83af3079-bfe6-43f9-bb96-a9ccb2f936e1/authorino/0.log" Jul 06 20:10:51.816573 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:51.816475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bzqx8_688375cd-3293-4439-aee4-d2e4ddb8e7ef/manager/0.log" Jul 06 20:10:53.702361 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:53.702325 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a1cbc23-6f8a-4111-948c-075d1d7d5cd4/alertmanager/0.log" Jul 06 20:10:53.757379 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:53.757348 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a1cbc23-6f8a-4111-948c-075d1d7d5cd4/config-reloader/0.log" Jul 06 20:10:53.829369 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:53.829339 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a1cbc23-6f8a-4111-948c-075d1d7d5cd4/kube-rbac-proxy-web/0.log" Jul 06 20:10:53.874901 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:53.874871 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a1cbc23-6f8a-4111-948c-075d1d7d5cd4/kube-rbac-proxy/0.log" Jul 06 20:10:53.915632 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:53.915593 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a1cbc23-6f8a-4111-948c-075d1d7d5cd4/kube-rbac-proxy-metric/0.log" Jul 06 20:10:53.965576 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:53.965504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a1cbc23-6f8a-4111-948c-075d1d7d5cd4/prom-label-proxy/0.log" Jul 06 20:10:54.013591 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:54.013563 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a1cbc23-6f8a-4111-948c-075d1d7d5cd4/init-config-reloader/0.log" Jul 06 20:10:54.129767 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:54.129720 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-wmn65_716ab8b2-cd5d-4189-8112-d4cc2f3528b3/kube-state-metrics/0.log" Jul 06 20:10:54.163041 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:54.163010 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-wmn65_716ab8b2-cd5d-4189-8112-d4cc2f3528b3/kube-rbac-proxy-main/0.log" Jul 06 20:10:54.199668 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:54.199632 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-wmn65_716ab8b2-cd5d-4189-8112-d4cc2f3528b3/kube-rbac-proxy-self/0.log" Jul 06 20:10:54.338430 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:54.338401 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qpkj_5a1ae032-2f27-4d6f-b91d-9592fb3dada9/node-exporter/0.log" Jul 06 20:10:54.374316 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:54.374287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qpkj_5a1ae032-2f27-4d6f-b91d-9592fb3dada9/kube-rbac-proxy/0.log" Jul 06 20:10:54.416879 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:54.416844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2qpkj_5a1ae032-2f27-4d6f-b91d-9592fb3dada9/init-textfile/0.log" Jul 06 20:10:55.389751 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.389715 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4"] Jul 06 20:10:55.404907 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.404867 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.406289 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.406259 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-pzn74_22a558fe-e459-4600-a837-65aa08d2a147/prometheus-operator-admission-webhook/0.log" Jul 06 20:10:55.416550 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.416518 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4"] Jul 06 20:10:55.494849 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.494824 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-668887b86b-bxnww_b11beb49-9f9d-49a1-91d9-3045ab20bf2b/telemeter-client/0.log" Jul 06 20:10:55.505126 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.505081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-lib-modules\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.505333 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.505209 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-podres\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.505333 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.505252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfldh\" (UniqueName: \"kubernetes.io/projected/e6361a41-c981-4b93-89e0-d0cca1b6135e-kube-api-access-jfldh\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.505443 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.505370 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-proc\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.505443 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.505416 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-sys\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.529930 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.529895 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-668887b86b-bxnww_b11beb49-9f9d-49a1-91d9-3045ab20bf2b/reload/0.log" Jul 06 20:10:55.571175 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.571132 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-668887b86b-bxnww_b11beb49-9f9d-49a1-91d9-3045ab20bf2b/kube-rbac-proxy/0.log" Jul 06 20:10:55.606562 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-podres\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.606562 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606565 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfldh\" (UniqueName: \"kubernetes.io/projected/e6361a41-c981-4b93-89e0-d0cca1b6135e-kube-api-access-jfldh\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.606904 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-proc\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.606904 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606697 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-podres\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.606904 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-sys\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.606904 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606760 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-proc\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.606904 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606804 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-sys\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.606904 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-lib-modules\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.607115 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.606997 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6361a41-c981-4b93-89e0-d0cca1b6135e-lib-modules\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.634400 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.634374 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfldh\" (UniqueName: \"kubernetes.io/projected/e6361a41-c981-4b93-89e0-d0cca1b6135e-kube-api-access-jfldh\") pod \"perf-node-gather-daemonset-jtkn4\" (UID: \"e6361a41-c981-4b93-89e0-d0cca1b6135e\") " pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.718199 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.718081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:55.876115 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:55.875673 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4"] Jul 06 20:10:56.699769 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:56.699736 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" event={"ID":"e6361a41-c981-4b93-89e0-d0cca1b6135e","Type":"ContainerStarted","Data":"4d50847c28330b5e1a7005828e4be4d70f1e87f6f49ec7bb8a58fe86e3396807"} Jul 06 20:10:56.700202 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:56.699789 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" event={"ID":"e6361a41-c981-4b93-89e0-d0cca1b6135e","Type":"ContainerStarted","Data":"c7955a341320fbd91d068cc66384a7eaa233770474256d498f5f6a48e8865f31"} Jul 06 20:10:56.700202 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:56.699939 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:10:56.740354 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:56.740299 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" podStartSLOduration=1.740282908 podStartE2EDuration="1.740282908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:56.739648835 +0000 UTC m=+2708.496818324" watchObservedRunningTime="2026-07-06 20:10:56.740282908 +0000 UTC m=+2708.497452400" Jul 06 20:10:58.367704 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:58.367677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66bbf674c8-pxwwt_f28ee9a6-7c2a-4657-946b-5b61b1deca8e/console/0.log" Jul 06 20:10:58.445806 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:58.445775 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-cdpmb_daf24101-2b0d-4ba3-a2ae-f27dcf2728a1/download-server/0.log" Jul 06 20:10:59.212832 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:10:59.212807 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-l6dd8_f3e0ad74-8cd3-45bb-84bd-5f5295a34e92/volume-data-source-validator/0.log" Jul 06 20:11:00.523006 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:00.522977 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l94z7_5c233f07-695a-4fb6-a84f-cf7a0bad9152/dns/0.log" Jul 06 20:11:00.557540 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:00.557510 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l94z7_5c233f07-695a-4fb6-a84f-cf7a0bad9152/kube-rbac-proxy/0.log" Jul 06 20:11:00.761076 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:00.761042 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rrngf_16032533-6dfb-4784-b7e5-ae615d9f64a0/dns-node-resolver/0.log" Jul 06 20:11:01.418274 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:01.418247 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qpk58_5bfdae79-1660-45da-bd6e-1eb9d9553e51/node-ca/0.log" Jul 06 20:11:02.717454 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:02.717421 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7wvf/perf-node-gather-daemonset-jtkn4" Jul 06 20:11:02.754196 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:02.754169 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-x6dkx_88261861-6a97-4346-9823-ef81b3f39aac/kube-auth-proxy/0.log" Jul 06 20:11:02.968587 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:02.968509 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b4ccd844f-dqkq6_1b86f430-aedd-43ae-a4fa-9bc4de23dc8b/router/0.log" Jul 06 20:11:03.967069 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:03.967041 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vqkrz_51af992f-db03-4ae9-8760-e1954a587473/serve-healthcheck-canary/0.log" Jul 06 20:11:04.616621 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:04.616579 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-2kcft_4704e030-ed0e-4863-9571-371255f1568a/insights-operator/0.log" Jul 06 20:11:04.618208 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:04.618066 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-2kcft_4704e030-ed0e-4863-9571-371255f1568a/insights-operator/1.log" Jul 06 20:11:04.650279 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:04.650246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-279sr_11fac460-bb97-487e-8adf-35bcc2164b86/kube-rbac-proxy/0.log" Jul 06 20:11:04.688596 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:04.688570 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-279sr_11fac460-bb97-487e-8adf-35bcc2164b86/exporter/0.log" Jul 06 20:11:04.724199 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:04.724171 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-279sr_11fac460-bb97-487e-8adf-35bcc2164b86/extractor/0.log" Jul 06 20:11:06.095994 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:06.095921 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-x6dkx_88261861-6a97-4346-9823-ef81b3f39aac/kube-auth-proxy/0.log" Jul 06 20:11:06.267249 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:06.267221 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b4ccd844f-dqkq6_1b86f430-aedd-43ae-a4fa-9bc4de23dc8b/router/0.log" Jul 06 20:11:07.763065 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:07.763033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-68c9f86fd7-x6dkx_88261861-6a97-4346-9823-ef81b3f39aac/kube-auth-proxy/0.log" Jul 06 20:11:07.924896 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:07.924868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-b4ccd844f-dqkq6_1b86f430-aedd-43ae-a4fa-9bc4de23dc8b/router/0.log" Jul 06 20:11:08.354493 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:08.354444 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-czm5p_f39faf9b-dfa4-465c-8a09-c8366dbac250/manager/0.log" Jul 06 20:11:08.405049 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:08.405022 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79c9ddb849-czm5p_f39faf9b-dfa4-465c-8a09-c8366dbac250/copy-manifests/0.log" Jul 06 20:11:09.875991 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:09.875958 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c85d89ddf-g42qb_207527af-32a5-414c-9b81-fd61746ac4a6/manager/1.log" Jul 06 20:11:09.876424 ip-10-0-136-35 kubenswrapper[2563]: I0706 20:11:09.876208 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c85d89ddf-g42qb_207527af-32a5-414c-9b81-fd61746ac4a6/manager/0.log"