Jun 02 01:20:08.108792 ip-10-0-140-112 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 01:20:08.108802 ip-10-0-140-112 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 01:20:08.108809 ip-10-0-140-112 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 01:20:08.109041 ip-10-0-140-112 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 01:20:18.250836 ip-10-0-140-112 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 01:20:18.250854 ip-10-0-140-112 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8aa9d071dec9437b9bc7a90394fda561 -- Jun 02 01:22:52.163907 ip-10-0-140-112 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:22:52.671902 ip-10-0-140-112 kubenswrapper[2609]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:22:52.671902 ip-10-0-140-112 kubenswrapper[2609]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:22:52.671902 ip-10-0-140-112 kubenswrapper[2609]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:22:52.671902 ip-10-0-140-112 kubenswrapper[2609]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:22:52.671902 ip-10-0-140-112 kubenswrapper[2609]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:22:52.672813 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.672725 2609 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:22:52.676452 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676435 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:52.676452 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676453 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676457 2609 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676459 2609 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676462 2609 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676464 2609 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676467 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676470 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676472 2609 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676475 2609 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676478 2609 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676480 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676484 2609 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676487 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676489 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676492 2609 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676494 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676497 2609 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676500 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676503 2609 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676505 2609 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:52.676541 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676508 2609 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676512 2609 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676516 2609 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676533 2609 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676536 2609 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676539 2609 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676541 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676544 2609 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676547 2609 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676550 2609 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676553 2609 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676555 2609 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676558 2609 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676560 2609 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676563 2609 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676565 2609 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676568 2609 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676570 2609 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676573 2609 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:52.677025 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676575 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676578 2609 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676580 2609 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676584 2609 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676586 2609 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676589 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676592 2609 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676595 2609 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676597 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676600 2609 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676602 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676605 2609 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676608 2609 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676610 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676613 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676616 2609 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676619 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676622 2609 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676625 2609 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:52.677543 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676627 2609 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676630 2609 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676633 2609 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676635 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676637 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676640 2609 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676643 2609 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676646 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676649 2609 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676652 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676654 2609 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676656 2609 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676659 2609 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676661 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676663 2609 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676666 2609 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676668 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676671 2609 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676675 2609 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676679 2609 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:52.678027 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676682 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676684 2609 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676687 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676689 2609 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676692 2609 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676696 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.676700 2609 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677119 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677125 2609 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677128 2609 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677130 2609 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677133 2609 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677136 2609 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677139 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677142 2609 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677144 2609 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677147 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677150 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677152 2609 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677160 2609 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:52.678548 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677163 2609 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677166 2609 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677168 2609 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677171 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677173 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677175 2609 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677178 2609 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677180 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677183 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677185 2609 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677188 2609 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677190 2609 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677193 2609 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677196 2609 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677198 2609 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677201 2609 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677203 2609 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677206 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677208 2609 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677210 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:52.679041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677215 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677217 2609 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677220 2609 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677222 2609 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677225 2609 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677227 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677230 2609 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677232 2609 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677235 2609 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677238 2609 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677240 2609 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677243 2609 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677246 2609 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677249 2609 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677252 2609 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677255 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677257 2609 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677259 2609 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677262 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677265 2609 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:52.679558 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677267 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677269 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677272 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677274 2609 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677277 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677280 2609 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677282 2609 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677284 2609 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677288 2609 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677292 2609 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677294 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677297 2609 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677300 2609 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677303 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677324 2609 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677328 2609 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677331 2609 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677334 2609 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677337 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:52.680061 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677339 2609 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677342 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677345 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677347 2609 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677350 2609 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677353 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677356 2609 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677359 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677361 2609 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677363 2609 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677367 2609 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677371 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677374 2609 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.677376 2609 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678928 2609 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678942 2609 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678951 2609 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678955 2609 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678960 2609 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678963 2609 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678967 2609 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:22:52.680546 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678972 2609 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678975 2609 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678978 2609 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678982 2609 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678985 2609 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678989 2609 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678992 2609 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678995 2609 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.678998 2609 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679000 2609 flags.go:64] FLAG: --cloud-config="" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679003 2609 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679006 2609 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679013 2609 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679016 2609 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679019 2609 flags.go:64] FLAG: --config-dir="" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679022 2609 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679025 2609 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679029 2609 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679039 2609 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679042 2609 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679046 2609 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679049 2609 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679052 2609 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679055 2609 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679058 2609 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:22:52.681084 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679061 2609 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679066 2609 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679068 2609 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679072 2609 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679074 2609 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679078 2609 flags.go:64] FLAG: --enable-server="true" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679090 2609 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679098 2609 flags.go:64] FLAG: --event-burst="100" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679101 2609 flags.go:64] FLAG: --event-qps="50" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679104 2609 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679107 2609 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679110 2609 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679114 2609 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679117 2609 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679120 2609 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679123 2609 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679126 2609 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679129 2609 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679132 2609 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679135 2609 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679138 2609 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679141 2609 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679144 2609 flags.go:64] FLAG: --feature-gates="" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679148 2609 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679151 2609 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:22:52.681718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679154 2609 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679163 2609 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679166 2609 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679169 2609 flags.go:64] FLAG: --help="false" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679172 2609 flags.go:64] FLAG: --hostname-override="ip-10-0-140-112.ec2.internal" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679175 2609 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679178 2609 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679181 2609 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679184 2609 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679187 2609 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679190 2609 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679193 2609 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679195 2609 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679198 2609 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679201 2609 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679204 2609 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679207 2609 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679210 2609 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679213 2609 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679217 2609 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679219 2609 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679222 2609 flags.go:64] FLAG: --lock-file="" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679225 2609 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679227 2609 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:22:52.682380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679231 2609 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679236 2609 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679239 2609 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679242 2609 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679245 2609 flags.go:64] FLAG: --logging-format="text" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679248 2609 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679251 2609 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679254 2609 flags.go:64] FLAG: --manifest-url="" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679257 2609 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679262 2609 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679265 2609 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679269 2609 flags.go:64] FLAG: --max-pods="110" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679272 2609 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679275 2609 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679278 2609 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679281 2609 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679284 2609 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679287 2609 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679290 2609 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679297 2609 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679300 2609 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679303 2609 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679306 2609 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:22:52.682989 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679309 2609 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679315 2609 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679317 2609 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679321 2609 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679324 2609 flags.go:64] FLAG: --port="10250" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679327 2609 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679331 2609 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d7fb1eef02a215d" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679334 2609 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679337 2609 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679340 2609 flags.go:64] FLAG: --register-node="true" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679343 2609 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679346 2609 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679349 2609 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679352 2609 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679355 2609 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679358 2609 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679362 2609 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679365 2609 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679368 2609 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679371 2609 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679375 2609 flags.go:64] FLAG: --runonce="false" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679377 2609 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679380 2609 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679383 2609 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679387 2609 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679390 2609 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:22:52.683571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679393 2609 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679396 2609 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679399 2609 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679402 2609 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679405 2609 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679407 2609 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679410 2609 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679413 2609 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679416 2609 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679419 2609 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679425 2609 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679428 2609 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679430 2609 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679435 2609 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679438 2609 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679440 2609 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679443 2609 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679446 2609 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679449 2609 flags.go:64] FLAG: --v="2" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679453 2609 flags.go:64] FLAG: --version="false" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679457 2609 flags.go:64] FLAG: --vmodule="" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679461 2609 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.679464 2609 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679594 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679598 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:52.684221 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679601 2609 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679604 2609 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679607 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679611 2609 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679615 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679617 2609 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679620 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679623 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679626 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679629 2609 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679632 2609 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679634 2609 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679637 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679639 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679642 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679644 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679647 2609 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679650 2609 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679653 2609 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:52.684853 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679656 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679658 2609 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679661 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679663 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679666 2609 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679669 2609 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679674 2609 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679677 2609 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679679 2609 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679682 2609 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679684 2609 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679687 2609 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679689 2609 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679692 2609 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679694 2609 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679697 2609 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679700 2609 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679702 2609 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679705 2609 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679707 2609 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:52.685333 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679710 2609 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679712 2609 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679714 2609 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679717 2609 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679719 2609 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679721 2609 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679724 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679726 2609 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679729 2609 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679732 2609 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679735 2609 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679738 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679741 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679743 2609 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679746 2609 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679748 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679750 2609 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679753 2609 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679756 2609 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679759 2609 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:52.685876 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679761 2609 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679763 2609 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679766 2609 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679768 2609 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679771 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679773 2609 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679776 2609 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679779 2609 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679781 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679785 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679788 2609 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679790 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679792 2609 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679795 2609 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679797 2609 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679799 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679802 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679804 2609 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679807 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679810 2609 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:52.686368 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679812 2609 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:52.686880 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679815 2609 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:52.686880 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679817 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:52.686880 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679820 2609 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:52.686880 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.679822 2609 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:52.686880 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.680386 2609 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:22:52.687121 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.687101 2609 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:22:52.687155 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.687122 2609 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:22:52.687186 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687171 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:52.687186 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687176 2609 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:52.687186 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687179 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:52.687186 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687183 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:52.687186 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687186 2609 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:52.687186 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687189 2609 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687192 2609 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687195 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687198 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687201 2609 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687203 2609 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687206 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687209 2609 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687211 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687214 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687217 2609 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687219 2609 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687222 2609 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687224 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687233 2609 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687236 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687238 2609 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687240 2609 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687243 2609 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687246 2609 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:52.687343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687248 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687250 2609 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687253 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687255 2609 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687258 2609 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687260 2609 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687282 2609 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687286 2609 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687289 2609 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687291 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687294 2609 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687296 2609 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687298 2609 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687301 2609 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687304 2609 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687307 2609 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687309 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687312 2609 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687314 2609 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687317 2609 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:52.687869 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687320 2609 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687322 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687325 2609 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687328 2609 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687330 2609 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687333 2609 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687335 2609 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687338 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687341 2609 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687343 2609 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687346 2609 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687348 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687351 2609 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687354 2609 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687356 2609 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687358 2609 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687361 2609 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687363 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687366 2609 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:52.688356 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687374 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687377 2609 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687380 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687382 2609 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687385 2609 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687387 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687391 2609 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687393 2609 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687396 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687398 2609 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687402 2609 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687407 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687410 2609 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687413 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687415 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687418 2609 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687421 2609 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687423 2609 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687426 2609 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:52.688845 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687429 2609 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687432 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687436 2609 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.687441 2609 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687587 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687593 2609 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687596 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687598 2609 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687601 2609 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687603 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687606 2609 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687609 2609 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687611 2609 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687613 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687622 2609 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:22:52.689313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687625 2609 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687627 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687629 2609 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687632 2609 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687634 2609 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687637 2609 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687639 2609 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687642 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687644 2609 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687647 2609 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687649 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687652 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687654 2609 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687657 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687660 2609 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687662 2609 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687665 2609 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687667 2609 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687669 2609 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687672 2609 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:22:52.689818 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687674 2609 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687677 2609 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687679 2609 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687682 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687684 2609 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687686 2609 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687690 2609 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687694 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687697 2609 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687700 2609 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687703 2609 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687705 2609 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687713 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687716 2609 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687719 2609 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687722 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687724 2609 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687727 2609 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687729 2609 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687732 2609 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:22:52.690313 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687734 2609 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687737 2609 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687739 2609 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687742 2609 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687744 2609 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687747 2609 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687749 2609 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687752 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687754 2609 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687756 2609 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687759 2609 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687761 2609 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687763 2609 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687766 2609 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687768 2609 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687771 2609 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687773 2609 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687777 2609 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687781 2609 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:22:52.690831 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687783 2609 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687786 2609 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687788 2609 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687791 2609 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687793 2609 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687795 2609 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687803 2609 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687806 2609 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687809 2609 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687812 2609 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687814 2609 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687817 2609 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687819 2609 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687822 2609 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687824 2609 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:22:52.691349 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:52.687827 2609 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:22:52.691766 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.687832 2609 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:22:52.691766 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.689105 2609 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:22:52.691766 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.691227 2609 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:22:52.692249 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.692238 2609 server.go:1019] "Starting client certificate rotation" Jun 02 01:22:52.692368 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.692351 2609 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:22:52.692424 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.692406 2609 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:22:52.722183 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.722153 2609 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:22:52.726803 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.726781 2609 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:22:52.751719 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.751694 2609 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:22:52.758627 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.758604 2609 log.go:25] "Validated CRI v1 image API" Jun 02 01:22:52.759891 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.759868 2609 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:22:52.762790 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.762765 2609 fs.go:135] Filesystem UUIDs: map[0ce6c38a-9104-4be9-84e3-7b73955bcaf1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a501b654-33d3-4f38-8197-422c3977e808:/dev/nvme0n1p4] Jun 02 01:22:52.762853 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.762789 2609 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:22:52.767138 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.767003 2609 manager.go:217] Machine: {Timestamp:2026-06-02 01:22:52.766476544 +0000 UTC m=+0.461398855 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102596 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aa7c7f55cf7c4dba1bb19f09875eb SystemUUID:ec2aa7c7-f55c-f7c4-dba1-bb19f09875eb BootID:8aa9d071-dec9-437b-9bc7-a90394fda561 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:a8:ea:15:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:a8:ea:15:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:9f:9d:22:1d:10 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:22:52.767869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.767858 2609 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:22:52.767960 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.767943 2609 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:22:52.768208 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.768193 2609 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:22:52.771763 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.771737 2609 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:22:52.771950 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.771766 2609 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-112.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:22:52.772076 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.771964 2609 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:22:52.772076 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.771977 2609 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:22:52.772076 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.771987 2609 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:22:52.773033 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.773020 2609 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:22:52.774391 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.774379 2609 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:22:52.774549 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.774538 2609 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:22:52.776973 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.776962 2609 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:22:52.777039 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.776980 2609 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:22:52.777039 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.776996 2609 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:22:52.777039 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.777011 2609 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:22:52.777039 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.777023 2609 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:22:52.778156 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.778142 2609 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:22:52.778233 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.778166 2609 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:22:52.783571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.783552 2609 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:22:52.787237 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.787218 2609 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:22:52.791446 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791429 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:22:52.791536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791451 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:22:52.791536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791469 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:22:52.791536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791479 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:22:52.791536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791488 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:22:52.791536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791499 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:22:52.791536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791505 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:22:52.791536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791511 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:22:52.791748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791539 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:22:52.791748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791556 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:22:52.791748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791565 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:22:52.791748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791571 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:22:52.791748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791599 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:22:52.791748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.791608 2609 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:22:52.796253 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.796229 2609 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:22:52.796253 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.796243 2609 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-112.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:22:52.796439 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.796416 2609 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:22:52.796634 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.796622 2609 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:22:52.796671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.796663 2609 server.go:1295] "Started kubelet" Jun 02 01:22:52.796765 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.796738 2609 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:22:52.796845 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.796732 2609 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:22:52.796890 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.796869 2609 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:22:52.797448 ip-10-0-140-112 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:22:52.798362 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.798275 2609 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:22:52.799814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.799798 2609 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:22:52.803572 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.803549 2609 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:22:52.804306 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.804292 2609 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:22:52.804499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.804472 2609 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:22:52.804499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.804488 2609 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:22:52.804663 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.804602 2609 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:22:52.804724 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.804666 2609 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:22:52.804724 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.804675 2609 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:22:52.805382 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.803332 2609 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-112.ec2.internal.18b51f0e06a8e789 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-112.ec2.internal,UID:ip-10-0-140-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-112.ec2.internal,},FirstTimestamp:2026-06-02 01:22:52.796635017 +0000 UTC m=+0.491557309,LastTimestamp:2026-06-02 01:22:52.796635017 +0000 UTC m=+0.491557309,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-112.ec2.internal,}" Jun 02 01:22:52.805382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.805334 2609 factory.go:55] Registering systemd factory Jun 02 01:22:52.805382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.805383 2609 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:22:52.805643 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.805628 2609 factory.go:153] Registering CRI-O factory Jun 02 01:22:52.805705 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.805648 2609 factory.go:223] Registration of the crio container factory successfully Jun 02 01:22:52.805705 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.805702 2609 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:22:52.805819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.805721 2609 factory.go:103] Registering Raw factory Jun 02 01:22:52.805819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.805736 2609 manager.go:1196] Started watching for new ooms in manager Jun 02 01:22:52.806055 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.806037 2609 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:22:52.806113 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.806071 2609 manager.go:319] Starting recovery of all containers Jun 02 01:22:52.806592 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.806566 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:52.808506 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.808487 2609 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 01:22:52.808637 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.808614 2609 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 01:22:52.816263 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.816109 2609 manager.go:324] Recovery completed Jun 02 01:22:52.821501 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.821488 2609 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:52.825570 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.825542 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:52.825637 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.825587 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:52.825637 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.825600 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:52.826243 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.826226 2609 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:22:52.826243 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.826240 2609 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:22:52.826350 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.826262 2609 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:22:52.828172 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.828099 2609 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-112.ec2.internal.18b51f0e08627456 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-112.ec2.internal,UID:ip-10-0-140-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-112.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-112.ec2.internal,},FirstTimestamp:2026-06-02 01:22:52.825572438 +0000 UTC m=+0.520494733,LastTimestamp:2026-06-02 01:22:52.825572438 +0000 UTC m=+0.520494733,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-112.ec2.internal,}" Jun 02 01:22:52.828684 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.828670 2609 policy_none.go:49] "None policy: Start" Jun 02 01:22:52.828730 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.828692 2609 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:22:52.828730 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.828703 2609 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:22:52.837982 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.837920 2609 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-112.ec2.internal.18b51f0e0862c6b9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-112.ec2.internal,UID:ip-10-0-140-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-112.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-112.ec2.internal,},FirstTimestamp:2026-06-02 01:22:52.825593529 +0000 UTC m=+0.520515821,LastTimestamp:2026-06-02 01:22:52.825593529 +0000 UTC m=+0.520515821,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-112.ec2.internal,}" Jun 02 01:22:52.847513 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.847426 2609 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-112.ec2.internal.18b51f0e0862f628 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-112.ec2.internal,UID:ip-10-0-140-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-112.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-112.ec2.internal,},FirstTimestamp:2026-06-02 01:22:52.825605672 +0000 UTC m=+0.520527966,LastTimestamp:2026-06-02 01:22:52.825605672 +0000 UTC m=+0.520527966,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-112.ec2.internal,}" Jun 02 01:22:52.857902 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.857881 2609 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmpzf" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.865881 2609 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zmpzf" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.866678 2609 manager.go:341] "Starting Device Plugin manager" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.866710 2609 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.866719 2609 server.go:85] "Starting device plugin registration server" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.866970 2609 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.866982 2609 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.867105 2609 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.867193 2609 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.867201 2609 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.867713 2609 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:22:52.869657 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.867743 2609 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:52.930311 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.930273 2609 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:22:52.931558 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.931543 2609 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:22:52.931624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.931572 2609 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:22:52.931624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.931588 2609 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:22:52.931624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.931595 2609 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:22:52.931735 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.931637 2609 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:22:52.935312 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.935294 2609 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:52.967416 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.967397 2609 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:52.968455 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.968433 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:52.968515 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.968461 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:52.968515 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.968473 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:52.968515 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.968496 2609 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-112.ec2.internal" Jun 02 01:22:52.976149 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:52.976135 2609 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-112.ec2.internal" Jun 02 01:22:52.976202 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.976162 2609 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-112.ec2.internal\": node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:52.990514 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:52.990491 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.032079 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.032057 2609 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal"] Jun 02 01:22:53.032175 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.032151 2609 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:53.033918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.033902 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:53.033982 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.033930 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:53.033982 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.033946 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:53.035429 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.035417 2609 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:53.035605 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.035591 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.035646 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.035622 2609 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:53.036128 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.036111 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:53.036209 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.036115 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:53.036209 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.036167 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:53.036209 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.036179 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:53.036209 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.036142 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:53.036336 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.036218 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:53.037906 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.037891 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.037992 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.037915 2609 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:22:53.038804 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.038791 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:22:53.038892 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.038816 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:22:53.038892 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.038828 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:22:53.064107 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.064080 2609 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-112.ec2.internal\" not found" node="ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.068167 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.068151 2609 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-112.ec2.internal\" not found" node="ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.090830 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.090812 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.106364 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.106345 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f53a7a81a0ec121df3f3bf7200c8808-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal\" (UID: \"7f53a7a81a0ec121df3f3bf7200c8808\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.106415 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.106370 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f53a7a81a0ec121df3f3bf7200c8808-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal\" (UID: \"7f53a7a81a0ec121df3f3bf7200c8808\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.106415 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.106385 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03a83b4ff4fc8afcd2787035eae18187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-112.ec2.internal\" (UID: \"03a83b4ff4fc8afcd2787035eae18187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.191641 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.191572 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.206881 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.206861 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f53a7a81a0ec121df3f3bf7200c8808-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal\" (UID: \"7f53a7a81a0ec121df3f3bf7200c8808\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.206945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.206888 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03a83b4ff4fc8afcd2787035eae18187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-112.ec2.internal\" (UID: \"03a83b4ff4fc8afcd2787035eae18187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.206945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.206906 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f53a7a81a0ec121df3f3bf7200c8808-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal\" (UID: \"7f53a7a81a0ec121df3f3bf7200c8808\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.206945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.206933 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7f53a7a81a0ec121df3f3bf7200c8808-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal\" (UID: \"7f53a7a81a0ec121df3f3bf7200c8808\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.207048 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.206959 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/03a83b4ff4fc8afcd2787035eae18187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-112.ec2.internal\" (UID: \"03a83b4ff4fc8afcd2787035eae18187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.207048 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.206959 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f53a7a81a0ec121df3f3bf7200c8808-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal\" (UID: \"7f53a7a81a0ec121df3f3bf7200c8808\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.292259 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.292224 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.366703 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.366673 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.371400 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.371386 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" Jun 02 01:22:53.392953 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.392925 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.493414 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.493364 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.593854 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.593837 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.630272 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.630251 2609 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:53.693370 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.693340 2609 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:22:53.693915 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.693483 2609 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:22:53.693915 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.693540 2609 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:22:53.694416 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.694401 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.794972 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.794916 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.803637 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.803621 2609 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:22:53.812501 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.812487 2609 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:22:53.836136 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.836111 2609 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xhkgz" Jun 02 01:22:53.843985 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.843962 2609 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xhkgz" Jun 02 01:22:53.868151 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.868120 2609 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:17:52 +0000 UTC" deadline="2027-12-16 02:52:04.435749634 +0000 UTC" Jun 02 01:22:53.868151 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.868148 2609 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13489h29m10.567604495s" Jun 02 01:22:53.895277 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.895258 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:53.903079 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:53.903040 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a83b4ff4fc8afcd2787035eae18187.slice/crio-b0bebaf2cbedc58150ee4038a9354b0cb5c8168f44ea15fede4bfb122805b492 WatchSource:0}: Error finding container b0bebaf2cbedc58150ee4038a9354b0cb5c8168f44ea15fede4bfb122805b492: Status 404 returned error can't find the container with id b0bebaf2cbedc58150ee4038a9354b0cb5c8168f44ea15fede4bfb122805b492 Jun 02 01:22:53.903279 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:53.903260 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f53a7a81a0ec121df3f3bf7200c8808.slice/crio-0cfd5e9100048c4cc32e8e341bfb961f6e079a925b6bd4e0a332acebc37ed773 WatchSource:0}: Error finding container 0cfd5e9100048c4cc32e8e341bfb961f6e079a925b6bd4e0a332acebc37ed773: Status 404 returned error can't find the container with id 0cfd5e9100048c4cc32e8e341bfb961f6e079a925b6bd4e0a332acebc37ed773 Jun 02 01:22:53.907284 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.907268 2609 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:22:53.934322 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.934275 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" event={"ID":"03a83b4ff4fc8afcd2787035eae18187","Type":"ContainerStarted","Data":"b0bebaf2cbedc58150ee4038a9354b0cb5c8168f44ea15fede4bfb122805b492"} Jun 02 01:22:53.935185 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:53.935167 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" event={"ID":"7f53a7a81a0ec121df3f3bf7200c8808","Type":"ContainerStarted","Data":"0cfd5e9100048c4cc32e8e341bfb961f6e079a925b6bd4e0a332acebc37ed773"} Jun 02 01:22:53.996333 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:53.996314 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:54.096843 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.096796 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:54.197319 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.197287 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:54.298110 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.298074 2609 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-112.ec2.internal\" not found" Jun 02 01:22:54.322471 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.322448 2609 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:54.351796 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.351713 2609 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:54.405677 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.405516 2609 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" Jun 02 01:22:54.423744 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.423718 2609 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:22:54.424955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.424935 2609 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" Jun 02 01:22:54.432866 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.432844 2609 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:22:54.778156 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.778118 2609 apiserver.go:52] "Watching apiserver" Jun 02 01:22:54.783082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.783057 2609 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:22:54.783451 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.783429 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ttt5v","kube-system/konnectivity-agent-vl5k9","kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal","openshift-image-registry/node-ca-m9xgw","openshift-multus/multus-7w4k5","openshift-multus/multus-additional-cni-plugins-lw54v","openshift-multus/network-metrics-daemon-w9s4l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d","openshift-cluster-node-tuning-operator/tuned-4hg74","openshift-dns/node-resolver-h7skf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal","openshift-network-diagnostics/network-check-target-g8w8h","openshift-network-operator/iptables-alerter-rvsqq"] Jun 02 01:22:54.786085 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.786059 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.786184 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.786096 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:54.786184 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.786156 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:22:54.787619 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.787600 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:54.787716 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.787664 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:22:54.788383 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.788162 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:22:54.788383 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.788170 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:22:54.788383 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.788240 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b4hl4\"" Jun 02 01:22:54.789109 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.789087 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.790425 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.790406 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.791735 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.791719 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:22:54.791823 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.791749 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:22:54.791972 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.791950 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:22:54.792078 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.792062 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:22:54.792171 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.792144 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ttvn6\"" Jun 02 01:22:54.792358 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.792339 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:22:54.792446 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.792385 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:22:54.792660 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.792639 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:22:54.792660 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.792654 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j86jz\"" Jun 02 01:22:54.793468 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.793449 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.793468 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.793468 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.794716 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.794698 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.795256 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795238 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:22:54.795353 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795265 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:22:54.795353 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795311 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mncp4\"" Jun 02 01:22:54.796045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795695 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:22:54.796045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795800 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:22:54.796045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795872 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:22:54.796045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795885 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mvfc4\"" Jun 02 01:22:54.796045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795902 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:22:54.796045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795804 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:22:54.796045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.795804 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:22:54.796415 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.796140 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:22:54.796415 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.796195 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.796636 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.796618 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kknss\"" Jun 02 01:22:54.796786 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.796658 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:22:54.796880 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.796848 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:22:54.797950 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.797931 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:54.799224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.799031 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:22:54.799224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.799086 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ncvtd\"" Jun 02 01:22:54.799377 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.799354 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:22:54.799431 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.799404 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.800133 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.800107 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:22:54.800246 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.800230 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l2s2w\"" Jun 02 01:22:54.801741 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.800731 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:22:54.801826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.801720 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:22:54.801826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.801798 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:22:54.801937 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.801828 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:22:54.801937 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.801861 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72fck\"" Jun 02 01:22:54.805852 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.805836 2609 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:22:54.815927 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.815909 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwrwh\" (UniqueName: \"kubernetes.io/projected/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-kube-api-access-wwrwh\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.816029 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.815940 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34271d8f-db17-455f-a495-36c129fa4e43-hosts-file\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.816029 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.815966 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53dde8e3-30f1-4d96-bf55-9125732564d0-agent-certs\") pod \"konnectivity-agent-vl5k9\" (UID: \"53dde8e3-30f1-4d96-bf55-9125732564d0\") " pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:54.816132 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816032 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-cni-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816132 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816066 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-k8s-cni-cncf-io\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816132 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816083 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-kubelet\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816132 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816100 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6hbp\" (UniqueName: \"kubernetes.io/projected/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-kube-api-access-p6hbp\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.816132 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816121 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-socket-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816139 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df41a2ec-587a-4e38-9c20-aaf03f33f56e-tmp\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816156 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-cnibin\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816172 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-socket-dir-parent\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816199 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816230 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-modprobe-d\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816259 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5rs\" (UniqueName: \"kubernetes.io/projected/df41a2ec-587a-4e38-9c20-aaf03f33f56e-kube-api-access-qs5rs\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816282 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-os-release\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816304 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-systemd\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816328 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-sys\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816382 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-ovn\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816404 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-kubernetes\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816439 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-cni-bin\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816466 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-etc-kubernetes\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816489 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-run-netns\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816512 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-systemd\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816570 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-etc-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816592 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysctl-d\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816608 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c575w\" (UniqueName: \"kubernetes.io/projected/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-kube-api-access-c575w\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816631 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-serviceca\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816655 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-system-cni-dir\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816674 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-systemd-units\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816690 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816715 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysconfig\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816751 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-cni-binary-copy\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.816832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816784 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816809 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysctl-conf\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816831 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-kubelet\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816845 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-sys-fs\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816861 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-hostroot\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816883 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816901 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnn7\" (UniqueName: \"kubernetes.io/projected/f3a241f1-218e-46fa-8d39-62513637c9c5-kube-api-access-prnn7\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816919 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816936 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-host-slash\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816956 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-var-lib-kubelet\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816977 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-system-cni-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.816994 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cnibin\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817043 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817080 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817109 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-env-overrides\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817124 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-ovnkube-script-lib\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.817588 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817139 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-iptables-alerter-script\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817154 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-host\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817167 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-run\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817189 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-lib-modules\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817206 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cni-binary-copy\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817223 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-var-lib-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817245 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-log-socket\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817259 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817275 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-registration-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817293 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-cni-multus\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817307 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-node-log\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817321 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-cni-netd\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817335 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-ovnkube-config\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817348 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34271d8f-db17-455f-a495-36c129fa4e43-tmp-dir\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817362 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53dde8e3-30f1-4d96-bf55-9125732564d0-konnectivity-ca\") pod \"konnectivity-agent-vl5k9\" (UID: \"53dde8e3-30f1-4d96-bf55-9125732564d0\") " pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817377 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-conf-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.818232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817402 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-daemon-config\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817417 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817430 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817444 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7tg2\" (UniqueName: \"kubernetes.io/projected/8d89e565-1742-4482-8257-7a0c252e7e9e-kube-api-access-r7tg2\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817472 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twg7x\" (UniqueName: \"kubernetes.io/projected/34271d8f-db17-455f-a495-36c129fa4e43-kube-api-access-twg7x\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817491 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-cni-bin\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817505 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-tuned\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817557 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-netns\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817578 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-multus-certs\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817616 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-host\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817640 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl586\" (UniqueName: \"kubernetes.io/projected/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-kube-api-access-zl586\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817657 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-os-release\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817677 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-slash\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817710 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3a241f1-218e-46fa-8d39-62513637c9c5-ovn-node-metrics-cert\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817729 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-device-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.818773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.817745 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2wf\" (UniqueName: \"kubernetes.io/projected/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-kube-api-access-5l2wf\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:54.844831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.844807 2609 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:17:53 +0000 UTC" deadline="2028-03-18 03:23:06.06347417 +0000 UTC" Jun 02 01:22:54.844831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.844829 2609 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15722h0m11.218647632s" Jun 02 01:22:54.918542 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918498 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-system-cni-dir\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.918700 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918548 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-systemd-units\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.918700 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918602 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-systemd-units\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.918700 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918605 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-system-cni-dir\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.918700 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918645 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.918700 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918667 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysconfig\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918717 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysconfig\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918744 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-cni-binary-copy\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918749 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918768 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918793 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysctl-conf\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918817 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-kubelet\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918840 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-sys-fs\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918847 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918864 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-hostroot\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918893 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-kubelet\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918890 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918928 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysctl-conf\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918938 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-sys-fs\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.918951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918944 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prnn7\" (UniqueName: \"kubernetes.io/projected/f3a241f1-218e-46fa-8d39-62513637c9c5-kube-api-access-prnn7\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918983 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.918961 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-hostroot\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919008 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-host-slash\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919044 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-var-lib-kubelet\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919067 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-system-cni-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919047 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-host-slash\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919096 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cnibin\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919109 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-var-lib-kubelet\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919121 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919065 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919146 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919142 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-system-cni-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919160 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cnibin\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919208 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-env-overrides\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919250 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-cni-binary-copy\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919251 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-ovnkube-script-lib\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.919934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919283 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-iptables-alerter-script\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919310 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-host\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919284 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919385 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-host\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919386 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-run\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919336 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-run\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919430 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-lib-modules\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919454 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cni-binary-copy\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919459 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919478 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-var-lib-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919516 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-log-socket\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919563 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919590 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-registration-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919606 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-log-socket\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919618 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-cni-multus\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919564 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-lib-modules\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919656 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.920656 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919670 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919686 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-node-log\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919692 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-registration-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919716 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-node-log\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919720 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-cni-netd\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919738 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-cni-multus\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919750 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-ovnkube-config\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919757 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-cni-netd\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919765 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-env-overrides\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919776 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34271d8f-db17-455f-a495-36c129fa4e43-tmp-dir\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919777 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-var-lib-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919802 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-iptables-alerter-script\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919845 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53dde8e3-30f1-4d96-bf55-9125732564d0-konnectivity-ca\") pod \"konnectivity-agent-vl5k9\" (UID: \"53dde8e3-30f1-4d96-bf55-9125732564d0\") " pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919895 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-conf-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919918 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-daemon-config\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919942 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919957 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-ovnkube-script-lib\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.921461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919962 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-conf-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919968 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.919993 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r7tg2\" (UniqueName: \"kubernetes.io/projected/8d89e565-1742-4482-8257-7a0c252e7e9e-kube-api-access-r7tg2\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920015 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twg7x\" (UniqueName: \"kubernetes.io/projected/34271d8f-db17-455f-a495-36c129fa4e43-kube-api-access-twg7x\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920039 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-cni-bin\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920043 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920062 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-tuned\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920085 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-netns\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920110 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-multus-certs\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920114 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34271d8f-db17-455f-a495-36c129fa4e43-tmp-dir\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920131 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-host\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920157 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zl586\" (UniqueName: \"kubernetes.io/projected/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-kube-api-access-zl586\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920195 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-os-release\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920223 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-slash\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920228 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-netns\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920248 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3a241f1-218e-46fa-8d39-62513637c9c5-ovn-node-metrics-cert\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920387 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f3a241f1-218e-46fa-8d39-62513637c9c5-ovnkube-config\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920617 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-os-release\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920674 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-device-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920708 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2wf\" (UniqueName: \"kubernetes.io/projected/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-kube-api-access-5l2wf\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920741 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwrwh\" (UniqueName: \"kubernetes.io/projected/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-kube-api-access-wwrwh\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920778 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34271d8f-db17-455f-a495-36c129fa4e43-hosts-file\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920276 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-cni-bin\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920809 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-cni-binary-copy\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920810 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53dde8e3-30f1-4d96-bf55-9125732564d0-agent-certs\") pod \"konnectivity-agent-vl5k9\" (UID: \"53dde8e3-30f1-4d96-bf55-9125732564d0\") " pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920866 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-cni-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920954 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-k8s-cni-cncf-io\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920984 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/53dde8e3-30f1-4d96-bf55-9125732564d0-konnectivity-ca\") pod \"konnectivity-agent-vl5k9\" (UID: \"53dde8e3-30f1-4d96-bf55-9125732564d0\") " pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.920992 2609 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921115 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-host\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921157 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-daemon-config\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921200 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-multus-certs\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921222 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-slash\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921290 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-cni-dir\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921389 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-device-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.922955 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921498 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/34271d8f-db17-455f-a495-36c129fa4e43-hosts-file\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921557 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-run-k8s-cni-cncf-io\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921597 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-kubelet\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921630 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6hbp\" (UniqueName: \"kubernetes.io/projected/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-kube-api-access-p6hbp\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921659 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-socket-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921691 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df41a2ec-587a-4e38-9c20-aaf03f33f56e-tmp\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921721 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-cnibin\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921751 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-socket-dir-parent\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921780 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921807 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-modprobe-d\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921840 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5rs\" (UniqueName: \"kubernetes.io/projected/df41a2ec-587a-4e38-9c20-aaf03f33f56e-kube-api-access-qs5rs\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921869 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-os-release\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921901 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-systemd\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921928 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-sys\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921950 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-ovn\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.921978 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-kubernetes\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922006 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-cni-bin\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922035 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-etc-kubernetes\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.923767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922068 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-run-netns\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922093 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-systemd\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922127 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-etc-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922159 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysctl-d\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922189 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c575w\" (UniqueName: \"kubernetes.io/projected/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-kube-api-access-c575w\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922193 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-modprobe-d\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922220 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-serviceca\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922258 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-cni-bin\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922500 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-os-release\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922590 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-systemd\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922606 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8d89e565-1742-4482-8257-7a0c252e7e9e-socket-dir\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922710 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-sys\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922773 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-ovn\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922817 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-etc-kubernetes\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922952 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-multus-socket-dir-parent\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.922958 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-run-systemd\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.923070 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.923157 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-sysctl-d\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.924447 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.923232 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:22:55.423191665 +0000 UTC m=+3.118113965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:54.925395 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.923363 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-etc-openvswitch\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.925395 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.923557 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-host-var-lib-kubelet\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.925395 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.923812 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-cnibin\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.925395 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.923855 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3a241f1-218e-46fa-8d39-62513637c9c5-host-run-netns\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.925395 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.923923 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-kubernetes\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.928494 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.925691 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:54.928494 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.925724 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:54.928494 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.925737 2609 projected.go:194] Error preparing data for projected volume kube-api-access-vv5dl for pod openshift-network-diagnostics/network-check-target-g8w8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:54.928494 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:54.925797 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl podName:2efe819c-bfb2-41ca-b87e-cfbf33976b6e nodeName:}" failed. No retries permitted until 2026-06-02 01:22:55.425781635 +0000 UTC m=+3.120703924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vv5dl" (UniqueName: "kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl") pod "network-check-target-g8w8h" (UID: "2efe819c-bfb2-41ca-b87e-cfbf33976b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:54.928494 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.925872 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-serviceca\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.928494 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.927428 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/df41a2ec-587a-4e38-9c20-aaf03f33f56e-etc-tuned\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.928494 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.927775 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f3a241f1-218e-46fa-8d39-62513637c9c5-ovn-node-metrics-cert\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.930164 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.930138 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnn7\" (UniqueName: \"kubernetes.io/projected/f3a241f1-218e-46fa-8d39-62513637c9c5-kube-api-access-prnn7\") pod \"ovnkube-node-ttt5v\" (UID: \"f3a241f1-218e-46fa-8d39-62513637c9c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:54.930300 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.930261 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/53dde8e3-30f1-4d96-bf55-9125732564d0-agent-certs\") pod \"konnectivity-agent-vl5k9\" (UID: \"53dde8e3-30f1-4d96-bf55-9125732564d0\") " pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:54.931404 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.931368 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl586\" (UniqueName: \"kubernetes.io/projected/9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1-kube-api-access-zl586\") pod \"node-ca-m9xgw\" (UID: \"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1\") " pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:54.931502 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.931467 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7tg2\" (UniqueName: \"kubernetes.io/projected/8d89e565-1742-4482-8257-7a0c252e7e9e-kube-api-access-r7tg2\") pod \"aws-ebs-csi-driver-node-5qj2d\" (UID: \"8d89e565-1742-4482-8257-7a0c252e7e9e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:54.932827 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.932803 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df41a2ec-587a-4e38-9c20-aaf03f33f56e-tmp\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.935278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.934257 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twg7x\" (UniqueName: \"kubernetes.io/projected/34271d8f-db17-455f-a495-36c129fa4e43-kube-api-access-twg7x\") pod \"node-resolver-h7skf\" (UID: \"34271d8f-db17-455f-a495-36c129fa4e43\") " pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:54.935278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.934661 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5rs\" (UniqueName: \"kubernetes.io/projected/df41a2ec-587a-4e38-9c20-aaf03f33f56e-kube-api-access-qs5rs\") pod \"tuned-4hg74\" (UID: \"df41a2ec-587a-4e38-9c20-aaf03f33f56e\") " pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:54.935278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.934924 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6hbp\" (UniqueName: \"kubernetes.io/projected/a4f343ec-b5d8-4641-84ed-2dc2d37ad4df-kube-api-access-p6hbp\") pod \"multus-additional-cni-plugins-lw54v\" (UID: \"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df\") " pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:54.935278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.935091 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c575w\" (UniqueName: \"kubernetes.io/projected/8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a-kube-api-access-c575w\") pod \"multus-7w4k5\" (UID: \"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a\") " pod="openshift-multus/multus-7w4k5" Jun 02 01:22:54.935278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.935098 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwrwh\" (UniqueName: \"kubernetes.io/projected/7675b8f4-50a5-47f6-8485-d2c9fa891c2e-kube-api-access-wwrwh\") pod \"iptables-alerter-rvsqq\" (UID: \"7675b8f4-50a5-47f6-8485-d2c9fa891c2e\") " pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:54.935574 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.935281 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2wf\" (UniqueName: \"kubernetes.io/projected/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-kube-api-access-5l2wf\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:54.987331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:54.987303 2609 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:55.108379 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.108313 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7w4k5" Jun 02 01:22:55.113910 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.113886 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m9xgw" Jun 02 01:22:55.121556 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.121536 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lw54v" Jun 02 01:22:55.128235 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.128216 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:22:55.135826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.135813 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" Jun 02 01:22:55.141366 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.141348 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4hg74" Jun 02 01:22:55.146878 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.146849 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h7skf" Jun 02 01:22:55.153482 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.153463 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:22:55.159075 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.159058 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rvsqq" Jun 02 01:22:55.407612 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.407586 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34271d8f_db17_455f_a495_36c129fa4e43.slice/crio-2391c7c9ea6121cb12d9768b83812a3e165a7947222d6b0eda768e24efad3258 WatchSource:0}: Error finding container 2391c7c9ea6121cb12d9768b83812a3e165a7947222d6b0eda768e24efad3258: Status 404 returned error can't find the container with id 2391c7c9ea6121cb12d9768b83812a3e165a7947222d6b0eda768e24efad3258 Jun 02 01:22:55.408958 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.408938 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f343ec_b5d8_4641_84ed_2dc2d37ad4df.slice/crio-290159a75a7f084b7f418b700b1f9d82ab9273815d05773baf29e0ace4946bbc WatchSource:0}: Error finding container 290159a75a7f084b7f418b700b1f9d82ab9273815d05773baf29e0ace4946bbc: Status 404 returned error can't find the container with id 290159a75a7f084b7f418b700b1f9d82ab9273815d05773baf29e0ace4946bbc Jun 02 01:22:55.409715 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.409674 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de0bb29_7de6_4b0b_9c7e_882f9b79b4a1.slice/crio-c6eafa11877f968e5353553cbc9c0c513586380f8c2f69788dc070647fac8f56 WatchSource:0}: Error finding container c6eafa11877f968e5353553cbc9c0c513586380f8c2f69788dc070647fac8f56: Status 404 returned error can't find the container with id c6eafa11877f968e5353553cbc9c0c513586380f8c2f69788dc070647fac8f56 Jun 02 01:22:55.412991 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.412969 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c3afb8b_6c0c_43bb_96e1_998fb2f9f95a.slice/crio-717a8c60cd29fdab45f40a578e8132e9c3a3ecc5631e08d9e4544b7e557fdeb8 WatchSource:0}: Error finding container 717a8c60cd29fdab45f40a578e8132e9c3a3ecc5631e08d9e4544b7e557fdeb8: Status 404 returned error can't find the container with id 717a8c60cd29fdab45f40a578e8132e9c3a3ecc5631e08d9e4544b7e557fdeb8 Jun 02 01:22:55.413933 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.413913 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53dde8e3_30f1_4d96_bf55_9125732564d0.slice/crio-1743c1ca1c28fb408543bd0dd0a33ae9b7a8445c7212b1b4511e3465d220a984 WatchSource:0}: Error finding container 1743c1ca1c28fb408543bd0dd0a33ae9b7a8445c7212b1b4511e3465d220a984: Status 404 returned error can't find the container with id 1743c1ca1c28fb408543bd0dd0a33ae9b7a8445c7212b1b4511e3465d220a984 Jun 02 01:22:55.415042 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.415023 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7675b8f4_50a5_47f6_8485_d2c9fa891c2e.slice/crio-7a48bb19a7b026b6e62fa3c2ed2bae422b121211c1de3a95cf9350688783895a WatchSource:0}: Error finding container 7a48bb19a7b026b6e62fa3c2ed2bae422b121211c1de3a95cf9350688783895a: Status 404 returned error can't find the container with id 7a48bb19a7b026b6e62fa3c2ed2bae422b121211c1de3a95cf9350688783895a Jun 02 01:22:55.415675 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.415652 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a241f1_218e_46fa_8d39_62513637c9c5.slice/crio-1302450451cc3d3150d265f33c9de3c7c50dd2e4295a5b584805b8746cb359cc WatchSource:0}: Error finding container 1302450451cc3d3150d265f33c9de3c7c50dd2e4295a5b584805b8746cb359cc: Status 404 returned error can't find the container with id 1302450451cc3d3150d265f33c9de3c7c50dd2e4295a5b584805b8746cb359cc Jun 02 01:22:55.416996 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:22:55.416956 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf41a2ec_587a_4e38_9c20_aaf03f33f56e.slice/crio-652c7d2c7e7cc596062694c746828e284c7191b5261ada4a03c4a74381532a33 WatchSource:0}: Error finding container 652c7d2c7e7cc596062694c746828e284c7191b5261ada4a03c4a74381532a33: Status 404 returned error can't find the container with id 652c7d2c7e7cc596062694c746828e284c7191b5261ada4a03c4a74381532a33 Jun 02 01:22:55.426264 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.426238 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:55.426363 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.426294 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:55.426422 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:55.426384 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:55.426422 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:55.426402 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:55.426422 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:55.426406 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:55.426422 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:55.426411 2609 projected.go:194] Error preparing data for projected volume kube-api-access-vv5dl for pod openshift-network-diagnostics/network-check-target-g8w8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:55.426641 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:55.426457 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:22:56.426440361 +0000 UTC m=+4.121362643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:55.426641 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:55.426482 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl podName:2efe819c-bfb2-41ca-b87e-cfbf33976b6e nodeName:}" failed. No retries permitted until 2026-06-02 01:22:56.426471178 +0000 UTC m=+4.121393461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vv5dl" (UniqueName: "kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl") pod "network-check-target-g8w8h" (UID: "2efe819c-bfb2-41ca-b87e-cfbf33976b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:55.845385 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.845188 2609 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:17:53 +0000 UTC" deadline="2028-01-27 16:20:27.714611021 +0000 UTC" Jun 02 01:22:55.845385 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.845382 2609 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14510h57m31.869232371s" Jun 02 01:22:55.846718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.846695 2609 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:22:55.932132 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.931847 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:55.932132 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:55.931986 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:22:55.966210 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.966177 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" event={"ID":"03a83b4ff4fc8afcd2787035eae18187","Type":"ContainerStarted","Data":"c60cbe2aff1341665757a141495bce1a1c11faee2a67c324d2127010a345c56d"} Jun 02 01:22:55.976921 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.976887 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" event={"ID":"8d89e565-1742-4482-8257-7a0c252e7e9e","Type":"ContainerStarted","Data":"30d6a76be9c4fefc3c4a030030cce3f23374d5429b72a312da1ca1ec94b82938"} Jun 02 01:22:55.986788 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.986759 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"1302450451cc3d3150d265f33c9de3c7c50dd2e4295a5b584805b8746cb359cc"} Jun 02 01:22:55.994164 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:55.994104 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m9xgw" event={"ID":"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1","Type":"ContainerStarted","Data":"c6eafa11877f968e5353553cbc9c0c513586380f8c2f69788dc070647fac8f56"} Jun 02 01:22:56.001714 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.001692 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7skf" event={"ID":"34271d8f-db17-455f-a495-36c129fa4e43","Type":"ContainerStarted","Data":"2391c7c9ea6121cb12d9768b83812a3e165a7947222d6b0eda768e24efad3258"} Jun 02 01:22:56.010262 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.009501 2609 generic.go:358] "Generic (PLEG): container finished" podID="7f53a7a81a0ec121df3f3bf7200c8808" containerID="c6d0b7b4b79068fb8bf5681a57b4c767fb21df8c01a935d10cc36630480f3843" exitCode=0 Jun 02 01:22:56.010693 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.010191 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" event={"ID":"7f53a7a81a0ec121df3f3bf7200c8808","Type":"ContainerDied","Data":"c6d0b7b4b79068fb8bf5681a57b4c767fb21df8c01a935d10cc36630480f3843"} Jun 02 01:22:56.024583 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.024511 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-112.ec2.internal" podStartSLOduration=2.024484898 podStartE2EDuration="2.024484898s" podCreationTimestamp="2026-06-02 01:22:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:22:55.979619799 +0000 UTC m=+3.674542101" watchObservedRunningTime="2026-06-02 01:22:56.024484898 +0000 UTC m=+3.719407201" Jun 02 01:22:56.025778 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.025748 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hg74" event={"ID":"df41a2ec-587a-4e38-9c20-aaf03f33f56e","Type":"ContainerStarted","Data":"652c7d2c7e7cc596062694c746828e284c7191b5261ada4a03c4a74381532a33"} Jun 02 01:22:56.032904 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.032882 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rvsqq" event={"ID":"7675b8f4-50a5-47f6-8485-d2c9fa891c2e","Type":"ContainerStarted","Data":"7a48bb19a7b026b6e62fa3c2ed2bae422b121211c1de3a95cf9350688783895a"} Jun 02 01:22:56.040438 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.040414 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vl5k9" event={"ID":"53dde8e3-30f1-4d96-bf55-9125732564d0","Type":"ContainerStarted","Data":"1743c1ca1c28fb408543bd0dd0a33ae9b7a8445c7212b1b4511e3465d220a984"} Jun 02 01:22:56.047180 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.047153 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7w4k5" event={"ID":"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a","Type":"ContainerStarted","Data":"717a8c60cd29fdab45f40a578e8132e9c3a3ecc5631e08d9e4544b7e557fdeb8"} Jun 02 01:22:56.069804 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.069781 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerStarted","Data":"290159a75a7f084b7f418b700b1f9d82ab9273815d05773baf29e0ace4946bbc"} Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.435832 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.435902 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:56.436042 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:56.436102 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:22:58.436084585 +0000 UTC m=+6.131006885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:56.436626 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:56.436667 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:56.436681 2609 projected.go:194] Error preparing data for projected volume kube-api-access-vv5dl for pod openshift-network-diagnostics/network-check-target-g8w8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:56.436853 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:56.436779 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl podName:2efe819c-bfb2-41ca-b87e-cfbf33976b6e nodeName:}" failed. No retries permitted until 2026-06-02 01:22:58.436710655 +0000 UTC m=+6.131632939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vv5dl" (UniqueName: "kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl") pod "network-check-target-g8w8h" (UID: "2efe819c-bfb2-41ca-b87e-cfbf33976b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:56.934952 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:56.934921 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:56.935384 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:56.935047 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:22:57.079237 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:57.079156 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" event={"ID":"7f53a7a81a0ec121df3f3bf7200c8808","Type":"ContainerStarted","Data":"8e5288fab47e7261ed13a70b345fd8100bde3c6e73db810d256f64b305cfff50"} Jun 02 01:22:57.932459 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:57.931979 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:57.932459 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:57.932118 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:22:58.451417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:58.451384 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:58.451879 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:58.451447 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:58.451879 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:58.451607 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:22:58.451879 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:58.451626 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:22:58.451879 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:58.451641 2609 projected.go:194] Error preparing data for projected volume kube-api-access-vv5dl for pod openshift-network-diagnostics/network-check-target-g8w8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:58.451879 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:58.451699 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl podName:2efe819c-bfb2-41ca-b87e-cfbf33976b6e nodeName:}" failed. No retries permitted until 2026-06-02 01:23:02.451680039 +0000 UTC m=+10.146602335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vv5dl" (UniqueName: "kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl") pod "network-check-target-g8w8h" (UID: "2efe819c-bfb2-41ca-b87e-cfbf33976b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:22:58.452139 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:58.452104 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:58.452256 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:58.452222 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:02.452207337 +0000 UTC m=+10.147129622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:22:58.934711 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:58.934216 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:22:58.934711 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:58.934341 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:22:59.933254 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:22:59.932779 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:22:59.933254 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:22:59.932929 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:00.935092 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:00.934635 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:00.935092 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:00.934738 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:01.932670 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:01.932640 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:01.932844 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:01.932746 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:02.485796 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:02.485761 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:02.486298 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:02.485822 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:02.486298 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:02.485946 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:02.486298 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:02.486009 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:10.485989053 +0000 UTC m=+18.180911335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:02.486496 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:02.486430 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:23:02.486496 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:02.486448 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:23:02.486496 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:02.486460 2609 projected.go:194] Error preparing data for projected volume kube-api-access-vv5dl for pod openshift-network-diagnostics/network-check-target-g8w8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:02.486661 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:02.486506 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl podName:2efe819c-bfb2-41ca-b87e-cfbf33976b6e nodeName:}" failed. No retries permitted until 2026-06-02 01:23:10.486490818 +0000 UTC m=+18.181413105 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vv5dl" (UniqueName: "kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl") pod "network-check-target-g8w8h" (UID: "2efe819c-bfb2-41ca-b87e-cfbf33976b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:02.933665 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:02.933631 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:02.933810 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:02.933750 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:03.932607 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:03.932574 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:03.933079 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:03.932706 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:04.932722 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:04.932687 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:04.933116 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:04.932784 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:05.932773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:05.932741 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:05.933182 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:05.932882 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:06.932396 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:06.932367 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:06.932587 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:06.932486 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:07.932674 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:07.932643 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:07.933159 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:07.932767 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:08.932934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:08.932618 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:08.932934 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:08.932739 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:09.932540 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:09.932489 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:09.932868 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:09.932644 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:10.547911 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:10.547869 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:10.548370 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:10.547947 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:10.548370 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:10.548096 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:23:10.548370 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:10.548117 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:23:10.548370 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:10.548131 2609 projected.go:194] Error preparing data for projected volume kube-api-access-vv5dl for pod openshift-network-diagnostics/network-check-target-g8w8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:10.548370 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:10.548186 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl podName:2efe819c-bfb2-41ca-b87e-cfbf33976b6e nodeName:}" failed. No retries permitted until 2026-06-02 01:23:26.5481683 +0000 UTC m=+34.243090584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vv5dl" (UniqueName: "kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl") pod "network-check-target-g8w8h" (UID: "2efe819c-bfb2-41ca-b87e-cfbf33976b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:10.548664 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:10.548647 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:10.548716 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:10.548706 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:26.548688819 +0000 UTC m=+34.243611100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:10.932798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:10.932766 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:10.932952 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:10.932889 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:11.932312 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:11.932284 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:11.932736 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:11.932402 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:12.932386 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:12.932361 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:12.932848 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:12.932458 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:13.933310 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:13.931847 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:13.933310 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:13.931975 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:14.111243 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.111073 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4hg74" event={"ID":"df41a2ec-587a-4e38-9c20-aaf03f33f56e","Type":"ContainerStarted","Data":"7cb2266e1af54e2b1f6d7f30d8b78e70a1c39eecaf8e41aaade5d1699e25c1cc"} Jun 02 01:23:14.112731 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.112704 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vl5k9" event={"ID":"53dde8e3-30f1-4d96-bf55-9125732564d0","Type":"ContainerStarted","Data":"34a371b77989db29b6077bb81762a22ae69da04b44b4c6685c15b721c19abccc"} Jun 02 01:23:14.114235 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.114210 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7w4k5" event={"ID":"8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a","Type":"ContainerStarted","Data":"d285de5d84847d2f09b2fc42c9ad4c2c65f41c32e466744242b1f41e00e865c5"} Jun 02 01:23:14.115853 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.115824 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerStarted","Data":"ff2168a12cf970d0b16e7b0b34c4174e1dc7df293ec919038bc580c3e9528e0d"} Jun 02 01:23:14.117295 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.117268 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" event={"ID":"8d89e565-1742-4482-8257-7a0c252e7e9e","Type":"ContainerStarted","Data":"25a42a09bea425ee09a77814262cfb62c1581baf686f231fd26bae13aece756f"} Jun 02 01:23:14.119750 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.119727 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"660f08070c97e1258195661c80213def09fae68d28ec952e676e4f1a758b074d"} Jun 02 01:23:14.120917 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.120896 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m9xgw" event={"ID":"9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1","Type":"ContainerStarted","Data":"e3b8ceee6e4f9606bdfc16cf05ac5201a40a67188b44b66bd5ea9f177b193d81"} Jun 02 01:23:14.122413 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.122390 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h7skf" event={"ID":"34271d8f-db17-455f-a495-36c129fa4e43","Type":"ContainerStarted","Data":"764ce7fac598815f1d185f7895520d36384eedcc132c63ec54fcbc1d4aec6fbf"} Jun 02 01:23:14.127036 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.126997 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4hg74" podStartSLOduration=2.772025898 podStartE2EDuration="21.126988092s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.418951676 +0000 UTC m=+3.113873957" lastFinishedPulling="2026-06-02 01:23:13.773913868 +0000 UTC m=+21.468836151" observedRunningTime="2026-06-02 01:23:14.126640987 +0000 UTC m=+21.821563313" watchObservedRunningTime="2026-06-02 01:23:14.126988092 +0000 UTC m=+21.821910393" Jun 02 01:23:14.127215 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.127188 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-112.ec2.internal" podStartSLOduration=20.127166013 podStartE2EDuration="20.127166013s" podCreationTimestamp="2026-06-02 01:22:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:22:57.094410663 +0000 UTC m=+4.789332963" watchObservedRunningTime="2026-06-02 01:23:14.127166013 +0000 UTC m=+21.822088314" Jun 02 01:23:14.140172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.140138 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-h7skf" podStartSLOduration=2.747819815 podStartE2EDuration="21.140127851s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.409638643 +0000 UTC m=+3.104560923" lastFinishedPulling="2026-06-02 01:23:13.801946667 +0000 UTC m=+21.496868959" observedRunningTime="2026-06-02 01:23:14.139911922 +0000 UTC m=+21.834834224" watchObservedRunningTime="2026-06-02 01:23:14.140127851 +0000 UTC m=+21.835050153" Jun 02 01:23:14.165658 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.165621 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m9xgw" podStartSLOduration=2.874599442 podStartE2EDuration="21.165607809s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.411294291 +0000 UTC m=+3.106216574" lastFinishedPulling="2026-06-02 01:23:13.702302656 +0000 UTC m=+21.397224941" observedRunningTime="2026-06-02 01:23:14.152686812 +0000 UTC m=+21.847609117" watchObservedRunningTime="2026-06-02 01:23:14.165607809 +0000 UTC m=+21.860530108" Jun 02 01:23:14.166203 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.166166 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vl5k9" podStartSLOduration=2.785903229 podStartE2EDuration="21.166160775s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.416368933 +0000 UTC m=+3.111291225" lastFinishedPulling="2026-06-02 01:23:13.796626479 +0000 UTC m=+21.491548771" observedRunningTime="2026-06-02 01:23:14.165751876 +0000 UTC m=+21.860674179" watchObservedRunningTime="2026-06-02 01:23:14.166160775 +0000 UTC m=+21.861083077" Jun 02 01:23:14.180250 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.180213 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7w4k5" podStartSLOduration=3.7954650020000003 podStartE2EDuration="22.180204137s" podCreationTimestamp="2026-06-02 01:22:52 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.414609939 +0000 UTC m=+3.109532232" lastFinishedPulling="2026-06-02 01:23:13.799349085 +0000 UTC m=+21.494271367" observedRunningTime="2026-06-02 01:23:14.180053188 +0000 UTC m=+21.874975490" watchObservedRunningTime="2026-06-02 01:23:14.180204137 +0000 UTC m=+21.875126439" Jun 02 01:23:14.932680 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:14.932502 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:14.932809 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:14.932750 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:15.125464 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.125435 2609 generic.go:358] "Generic (PLEG): container finished" podID="a4f343ec-b5d8-4641-84ed-2dc2d37ad4df" containerID="ff2168a12cf970d0b16e7b0b34c4174e1dc7df293ec919038bc580c3e9528e0d" exitCode=0 Jun 02 01:23:15.126081 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.125544 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerDied","Data":"ff2168a12cf970d0b16e7b0b34c4174e1dc7df293ec919038bc580c3e9528e0d"} Jun 02 01:23:15.129008 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.128978 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:23:15.129350 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.129315 2609 generic.go:358] "Generic (PLEG): container finished" podID="f3a241f1-218e-46fa-8d39-62513637c9c5" containerID="163589cce25bce89f8d482f78661651e9129a32f41232c85984a38feb3bb9dcb" exitCode=1 Jun 02 01:23:15.129465 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.129424 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"4804ba1e26eba39daa694eabb6a0a3c1d25d323d853936fd8e31bd6cd40656f5"} Jun 02 01:23:15.129465 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.129453 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"87d73342bf8ebdc4cfb30611b6b49757a569bb63378114def39e43bdd27776cf"} Jun 02 01:23:15.129651 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.129468 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"ff416889336118ac00a2cc3f95364c17ccae6736ddceb258071d23c07a0c5068"} Jun 02 01:23:15.129651 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.129481 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"d8d15c5b027e53708175f02dbfda5513c1a6aac142cbf8b2e3639315d0a722ed"} Jun 02 01:23:15.129651 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.129495 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerDied","Data":"163589cce25bce89f8d482f78661651e9129a32f41232c85984a38feb3bb9dcb"} Jun 02 01:23:15.215578 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.215552 2609 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:23:15.879979 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.879843 2609 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:23:15.215575796Z","UUID":"1c0d5e18-6859-492f-9b7d-ee847e1d3527","Handler":null,"Name":"","Endpoint":""} Jun 02 01:23:15.883399 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.883372 2609 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:23:15.883548 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.883407 2609 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:23:15.931986 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:15.931954 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:15.932143 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:15.932092 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:16.133003 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:16.132924 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rvsqq" event={"ID":"7675b8f4-50a5-47f6-8485-d2c9fa891c2e","Type":"ContainerStarted","Data":"003111f474d925c5116814790af9a67c589083e0eed6a11fc221a7538fa28748"} Jun 02 01:23:16.135214 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:16.135163 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:23:16.136064 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:16.135662 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" event={"ID":"8d89e565-1742-4482-8257-7a0c252e7e9e","Type":"ContainerStarted","Data":"af71ed6350829bd82b30b12cfe8fa6254c7354042cdc25b1c1a680a4ca7e8800"} Jun 02 01:23:16.148932 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:16.148891 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rvsqq" podStartSLOduration=4.769563245 podStartE2EDuration="23.148881273s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.41679659 +0000 UTC m=+3.111718871" lastFinishedPulling="2026-06-02 01:23:13.796114614 +0000 UTC m=+21.491036899" observedRunningTime="2026-06-02 01:23:16.148667484 +0000 UTC m=+23.843589790" watchObservedRunningTime="2026-06-02 01:23:16.148881273 +0000 UTC m=+23.843803574" Jun 02 01:23:16.932717 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:16.932540 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:16.932878 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:16.932797 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:17.020251 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.020176 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:23:17.020858 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.020840 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:23:17.139368 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.139334 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" event={"ID":"8d89e565-1742-4482-8257-7a0c252e7e9e","Type":"ContainerStarted","Data":"71f3ef5017c5b64b73651f8be9d5d2be877ea143950795556e836572e4275252"} Jun 02 01:23:17.141847 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.141830 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:23:17.142185 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.142158 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"f9fa8fb1f86accae3312654b6c90a744b2dce3b19b041eb4b31c3f90fd873a9d"} Jun 02 01:23:17.142787 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.142770 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vl5k9" Jun 02 01:23:17.158331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.158295 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5qj2d" podStartSLOduration=3.354872565 podStartE2EDuration="24.158283076s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.421407001 +0000 UTC m=+3.116329285" lastFinishedPulling="2026-06-02 01:23:16.224817516 +0000 UTC m=+23.919739796" observedRunningTime="2026-06-02 01:23:17.158140398 +0000 UTC m=+24.853062703" watchObservedRunningTime="2026-06-02 01:23:17.158283076 +0000 UTC m=+24.853205377" Jun 02 01:23:17.931898 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:17.931866 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:17.932035 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:17.931963 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:18.932035 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:18.932005 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:18.932571 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:18.932141 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:19.931924 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:19.931894 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:19.932101 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:19.932005 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:20.932891 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:20.932722 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:20.933414 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:20.932948 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:21.150708 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.150672 2609 generic.go:358] "Generic (PLEG): container finished" podID="a4f343ec-b5d8-4641-84ed-2dc2d37ad4df" containerID="27425c14f6b7634011b15ac53451aa9dd435244ba36cb2d216f9194b77951f25" exitCode=0 Jun 02 01:23:21.150870 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.150750 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerDied","Data":"27425c14f6b7634011b15ac53451aa9dd435244ba36cb2d216f9194b77951f25"} Jun 02 01:23:21.153712 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.153695 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:23:21.154046 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.154028 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"3e2c5d9ec1d7611206e2557a706793a4c9f0e40277fcdd0324bcf9ab1048c651"} Jun 02 01:23:21.154350 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.154330 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:23:21.154350 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.154355 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:23:21.154596 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.154517 2609 scope.go:117] "RemoveContainer" containerID="163589cce25bce89f8d482f78661651e9129a32f41232c85984a38feb3bb9dcb" Jun 02 01:23:21.170226 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.170209 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:23:21.931908 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:21.931877 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:21.932082 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:21.932051 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:22.126640 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.126564 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g8w8h"] Jun 02 01:23:22.126980 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.126701 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:22.126980 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:22.126809 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:22.130050 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.130027 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w9s4l"] Jun 02 01:23:22.158238 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.158212 2609 generic.go:358] "Generic (PLEG): container finished" podID="a4f343ec-b5d8-4641-84ed-2dc2d37ad4df" containerID="8b198f633104662d1814b02363a4ae0aea96702ca41affd5145a12e2b167b903" exitCode=0 Jun 02 01:23:22.158344 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.158297 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerDied","Data":"8b198f633104662d1814b02363a4ae0aea96702ca41affd5145a12e2b167b903"} Jun 02 01:23:22.162417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.162388 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:23:22.162829 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.162805 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:22.162918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.162804 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" event={"ID":"f3a241f1-218e-46fa-8d39-62513637c9c5","Type":"ContainerStarted","Data":"7ee6df8817cef6f7fda8e4fef06210b868726699def0ea59a9636d246459c9b4"} Jun 02 01:23:22.162987 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:22.162942 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:22.163307 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.163278 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:23:22.181194 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.181171 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:23:22.201474 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:22.201438 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" podStartSLOduration=10.797184639 podStartE2EDuration="29.201426871s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.418365869 +0000 UTC m=+3.113288151" lastFinishedPulling="2026-06-02 01:23:13.822608102 +0000 UTC m=+21.517530383" observedRunningTime="2026-06-02 01:23:22.201085783 +0000 UTC m=+29.896008085" watchObservedRunningTime="2026-06-02 01:23:22.201426871 +0000 UTC m=+29.896349169" Jun 02 01:23:23.166602 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:23.166393 2609 generic.go:358] "Generic (PLEG): container finished" podID="a4f343ec-b5d8-4641-84ed-2dc2d37ad4df" containerID="f62bdb64ef81efab80d0346b17a5c32e60173ce1b1af3c24bd45eff709183b56" exitCode=0 Jun 02 01:23:23.166928 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:23.166475 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerDied","Data":"f62bdb64ef81efab80d0346b17a5c32e60173ce1b1af3c24bd45eff709183b56"} Jun 02 01:23:23.932156 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:23.932125 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:23.932294 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:23.932242 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:23.932330 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:23.932300 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:23.932415 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:23.932398 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:25.931852 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:25.931824 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:25.932543 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:25.931824 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:25.932543 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:25.931938 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g8w8h" podUID="2efe819c-bfb2-41ca-b87e-cfbf33976b6e" Jun 02 01:23:25.932543 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:25.932048 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w9s4l" podUID="c24605d8-ee39-4c34-a643-e2fca2ffa4ed" Jun 02 01:23:26.568000 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.567963 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:26.568176 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.568017 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:26.568176 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.568110 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:26.568176 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.568124 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:23:26.568176 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.568139 2609 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:23:26.568176 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.568151 2609 projected.go:194] Error preparing data for projected volume kube-api-access-vv5dl for pod openshift-network-diagnostics/network-check-target-g8w8h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:26.568176 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.568175 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:58.568157033 +0000 UTC m=+66.263079333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:23:26.568409 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.568190 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl podName:2efe819c-bfb2-41ca-b87e-cfbf33976b6e nodeName:}" failed. No retries permitted until 2026-06-02 01:23:58.568180569 +0000 UTC m=+66.263102866 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vv5dl" (UniqueName: "kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl") pod "network-check-target-g8w8h" (UID: "2efe819c-bfb2-41ca-b87e-cfbf33976b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:23:26.611774 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.611746 2609 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-112.ec2.internal" event="NodeReady" Jun 02 01:23:26.611953 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.611882 2609 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:23:26.653567 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.653481 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vz56r"] Jun 02 01:23:26.660632 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.660603 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r8gwk"] Jun 02 01:23:26.660777 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.660760 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.662323 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.662306 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:26.662819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.662787 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:23:26.662819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.662809 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:23:26.662943 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.662853 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8tqnd\"" Jun 02 01:23:26.664190 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.664166 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:23:26.664190 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.664179 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:23:26.664348 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.664230 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:23:26.664348 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.664285 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xz25b\"" Jun 02 01:23:26.669164 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.668610 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vz56r"] Jun 02 01:23:26.670624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.670602 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8gwk"] Jun 02 01:23:26.769647 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.769621 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8rfk\" (UniqueName: \"kubernetes.io/projected/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-kube-api-access-f8rfk\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.769647 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.769654 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-tmp-dir\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.769869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.769682 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brvx4\" (UniqueName: \"kubernetes.io/projected/60bd9749-f749-411f-bd85-6c73d2dfe4ed-kube-api-access-brvx4\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:26.769869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.769747 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-config-volume\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.769869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.769785 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:26.769869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.769806 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.870731 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.870702 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8rfk\" (UniqueName: \"kubernetes.io/projected/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-kube-api-access-f8rfk\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.870731 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.870734 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-tmp-dir\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.870944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.870757 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-brvx4\" (UniqueName: \"kubernetes.io/projected/60bd9749-f749-411f-bd85-6c73d2dfe4ed-kube-api-access-brvx4\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:26.870944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.870799 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-config-volume\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.870944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.870832 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:26.870944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.870862 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.871143 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.870951 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:26.871143 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.870980 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:26.871143 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.871026 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:27.370998494 +0000 UTC m=+35.065920777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:23:26.871143 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:26.871047 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:27.371036211 +0000 UTC m=+35.065958490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:23:26.871143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.871121 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-tmp-dir\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.871358 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.871337 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-config-volume\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.884013 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.883987 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8rfk\" (UniqueName: \"kubernetes.io/projected/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-kube-api-access-f8rfk\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:26.885290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:26.885268 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brvx4\" (UniqueName: \"kubernetes.io/projected/60bd9749-f749-411f-bd85-6c73d2dfe4ed-kube-api-access-brvx4\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:27.374988 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.374957 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:27.374988 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.375001 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:27.375743 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:27.375109 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:27.375743 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:27.375132 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:27.375743 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:27.375175 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:28.375157447 +0000 UTC m=+36.070079728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:23:27.375743 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:27.375192 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:28.375184664 +0000 UTC m=+36.070106945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:23:27.931773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.931738 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:27.931956 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.931927 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:27.934620 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.934430 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:23:27.935119 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.935099 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tm89p\"" Jun 02 01:23:27.935225 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.935183 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jprs5\"" Jun 02 01:23:27.935415 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.935391 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:23:27.935728 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:27.935585 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:23:28.382650 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:28.382553 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:28.382650 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:28.382606 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:28.383108 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:28.382722 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:28.383108 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:28.382740 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:28.383108 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:28.382800 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:30.382778883 +0000 UTC m=+38.077701164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:23:28.383108 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:28.382820 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:30.382811572 +0000 UTC m=+38.077733867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:23:30.184115 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:30.183934 2609 generic.go:358] "Generic (PLEG): container finished" podID="a4f343ec-b5d8-4641-84ed-2dc2d37ad4df" containerID="38df6aead86c775b13ddeb70bf3d2d877ac84ace43b3bad915f368aea582dbb7" exitCode=0 Jun 02 01:23:30.184115 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:30.184009 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerDied","Data":"38df6aead86c775b13ddeb70bf3d2d877ac84ace43b3bad915f368aea582dbb7"} Jun 02 01:23:30.397631 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:30.397606 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:30.397743 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:30.397640 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:30.397782 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:30.397743 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:30.397782 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:30.397747 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:30.397845 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:30.397793 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:34.397778301 +0000 UTC m=+42.092700580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:23:30.397845 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:30.397805 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:34.397799068 +0000 UTC m=+42.092721348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:23:31.188485 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:31.188454 2609 generic.go:358] "Generic (PLEG): container finished" podID="a4f343ec-b5d8-4641-84ed-2dc2d37ad4df" containerID="369deffd92eb77be16bdcefc60cd9fe1d9ce25cb9f93c5a57d0b81808c8ebfae" exitCode=0 Jun 02 01:23:31.188831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:31.188504 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerDied","Data":"369deffd92eb77be16bdcefc60cd9fe1d9ce25cb9f93c5a57d0b81808c8ebfae"} Jun 02 01:23:32.192748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:32.192715 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lw54v" event={"ID":"a4f343ec-b5d8-4641-84ed-2dc2d37ad4df","Type":"ContainerStarted","Data":"4c182e79843430e183037595b164a970f5b7b3c795c60d150233c8bb14d55cba"} Jun 02 01:23:32.215459 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:32.215407 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lw54v" podStartSLOduration=5.420954011 podStartE2EDuration="39.215392653s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:22:55.411337631 +0000 UTC m=+3.106259913" lastFinishedPulling="2026-06-02 01:23:29.205776266 +0000 UTC m=+36.900698555" observedRunningTime="2026-06-02 01:23:32.214705363 +0000 UTC m=+39.909627666" watchObservedRunningTime="2026-06-02 01:23:32.215392653 +0000 UTC m=+39.910314955" Jun 02 01:23:34.423160 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:34.423128 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:34.423160 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:34.423165 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:34.423597 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:34.423261 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:34.423597 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:34.423265 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:34.423597 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:34.423314 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:42.423299132 +0000 UTC m=+50.118221415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:23:34.423597 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:34.423327 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:42.423321849 +0000 UTC m=+50.118244128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:23:42.479586 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:42.479546 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:42.480074 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:42.479607 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:42.480074 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:42.479629 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:42.480074 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:42.479695 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:23:58.479677283 +0000 UTC m=+66.174599580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:23:42.480074 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:42.479767 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:42.480074 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:42.479836 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:23:58.479820476 +0000 UTC m=+66.174742756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:23:54.179882 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:54.179849 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ttt5v" Jun 02 01:23:58.573105 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.573059 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:23:58.573105 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.573113 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:23:58.573661 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.573137 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:23:58.573661 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.573168 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:58.573661 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:58.573202 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:23:58.573661 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:58.573224 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:23:58.573661 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:58.573278 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:24:30.573260893 +0000 UTC m=+98.268183173 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:23:58.573661 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:58.573297 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:24:30.57328885 +0000 UTC m=+98.268211130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:23:58.575716 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.575696 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:23:58.575716 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.575717 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:23:58.583709 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:58.583693 2609 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:23:58.583795 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:23:58.583745 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs podName:c24605d8-ee39-4c34-a643-e2fca2ffa4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:25:02.583732563 +0000 UTC m=+130.278654843 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs") pod "network-metrics-daemon-w9s4l" (UID: "c24605d8-ee39-4c34-a643-e2fca2ffa4ed") : secret "metrics-daemon-secret" not found Jun 02 01:23:58.585329 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.585315 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:23:58.597320 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.597302 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv5dl\" (UniqueName: \"kubernetes.io/projected/2efe819c-bfb2-41ca-b87e-cfbf33976b6e-kube-api-access-vv5dl\") pod \"network-check-target-g8w8h\" (UID: \"2efe819c-bfb2-41ca-b87e-cfbf33976b6e\") " pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:58.846290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.846227 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tm89p\"" Jun 02 01:23:58.854177 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:58.854156 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:23:59.011278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:59.011241 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g8w8h"] Jun 02 01:23:59.015233 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:23:59.015207 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2efe819c_bfb2_41ca_b87e_cfbf33976b6e.slice/crio-7797113ef3d5e522263a03b437a0d33edcdde092b0dfc597629a96eee51d5c84 WatchSource:0}: Error finding container 7797113ef3d5e522263a03b437a0d33edcdde092b0dfc597629a96eee51d5c84: Status 404 returned error can't find the container with id 7797113ef3d5e522263a03b437a0d33edcdde092b0dfc597629a96eee51d5c84 Jun 02 01:23:59.242059 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:23:59.242033 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g8w8h" event={"ID":"2efe819c-bfb2-41ca-b87e-cfbf33976b6e","Type":"ContainerStarted","Data":"7797113ef3d5e522263a03b437a0d33edcdde092b0dfc597629a96eee51d5c84"} Jun 02 01:24:03.250030 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:03.249996 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g8w8h" event={"ID":"2efe819c-bfb2-41ca-b87e-cfbf33976b6e","Type":"ContainerStarted","Data":"db44707d0b75644151ed2f52282e0ae47deea2bde53431ac06315daa69eea0a4"} Jun 02 01:24:03.250424 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:03.250156 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:24:03.264802 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:03.264754 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g8w8h" podStartSLOduration=67.241156573 podStartE2EDuration="1m11.264741243s" podCreationTimestamp="2026-06-02 01:22:52 +0000 UTC" firstStartedPulling="2026-06-02 01:23:59.017599031 +0000 UTC m=+66.712521311" lastFinishedPulling="2026-06-02 01:24:03.041183699 +0000 UTC m=+70.736105981" observedRunningTime="2026-06-02 01:24:03.264398309 +0000 UTC m=+70.959320624" watchObservedRunningTime="2026-06-02 01:24:03.264741243 +0000 UTC m=+70.959663545" Jun 02 01:24:30.577081 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:30.576961 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:24:30.577081 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:30.577021 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:24:30.577576 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:24:30.577102 2609 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:24:30.577576 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:24:30.577106 2609 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:24:30.577576 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:24:30.577163 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert podName:60bd9749-f749-411f-bd85-6c73d2dfe4ed nodeName:}" failed. No retries permitted until 2026-06-02 01:25:34.577148316 +0000 UTC m=+162.272070595 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert") pod "ingress-canary-r8gwk" (UID: "60bd9749-f749-411f-bd85-6c73d2dfe4ed") : secret "canary-serving-cert" not found Jun 02 01:24:30.577576 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:24:30.577176 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls podName:c2eeaf9f-12dd-4ed2-925b-bc327f84fb54 nodeName:}" failed. No retries permitted until 2026-06-02 01:25:34.577170479 +0000 UTC m=+162.272092758 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls") pod "dns-default-vz56r" (UID: "c2eeaf9f-12dd-4ed2-925b-bc327f84fb54") : secret "dns-default-metrics-tls" not found Jun 02 01:24:34.253514 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:34.253487 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g8w8h" Jun 02 01:24:42.523786 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.523749 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6"] Jun 02 01:24:42.525547 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.525514 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" Jun 02 01:24:42.527914 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.527888 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-96x9s"] Jun 02 01:24:42.528810 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.528793 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:24:42.528877 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.528853 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-6cfpj\"" Jun 02 01:24:42.528963 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.528944 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 01:24:42.529968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.529949 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-85f4s"] Jun 02 01:24:42.530085 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.530072 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.531615 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.531598 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.535864 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.535847 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 01:24:42.535976 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.535877 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 01:24:42.535976 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.535915 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 01:24:42.535976 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.535942 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 01:24:42.536115 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.536092 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:24:42.536746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.536623 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 01:24:42.536746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.536647 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:24:42.536746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.536661 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-twss5\"" Jun 02 01:24:42.536746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.536665 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d8qp8\"" Jun 02 01:24:42.536956 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.536908 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:24:42.541956 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.541935 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 01:24:42.542607 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.542508 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 01:24:42.546076 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.546050 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6"] Jun 02 01:24:42.547399 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.547377 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-85f4s"] Jun 02 01:24:42.548489 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.548450 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-96x9s"] Jun 02 01:24:42.621781 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.621743 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq"] Jun 02 01:24:42.623605 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.623583 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.625715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.625689 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:24:42.625843 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.625783 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zvzs5\"" Jun 02 01:24:42.625843 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.625804 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 01:24:42.625843 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.625808 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 01:24:42.626087 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.626065 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 01:24:42.628487 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.628463 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8"] Jun 02 01:24:42.630242 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.630221 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.632610 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.632590 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 01:24:42.632706 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.632626 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-462jw\"" Jun 02 01:24:42.632706 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.632590 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:24:42.632706 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.632681 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 01:24:42.633015 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.633002 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 01:24:42.636820 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.636802 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq"] Jun 02 01:24:42.645281 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.645260 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8"] Jun 02 01:24:42.656706 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656687 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/370bb775-0ebd-495e-b42e-d92a9c89c419-tmp\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.656814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656789 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/370bb775-0ebd-495e-b42e-d92a9c89c419-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.656882 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656822 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/370bb775-0ebd-495e-b42e-d92a9c89c419-serving-cert\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.656882 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656851 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b36740ed-c338-43c2-a469-a9b3863700d8-config\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.656882 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656876 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b36740ed-c338-43c2-a469-a9b3863700d8-serving-cert\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.657026 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656922 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cf38036-924d-44f6-aac1-a2a83b04d5c5-config\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.657026 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656959 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cf38036-924d-44f6-aac1-a2a83b04d5c5-serving-cert\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.657026 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.656994 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/3cf38036-924d-44f6-aac1-a2a83b04d5c5-kube-api-access-7hkqw\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.657026 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.657019 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b36740ed-c338-43c2-a469-a9b3863700d8-trusted-ca\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.657216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.657057 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdrjh\" (UniqueName: \"kubernetes.io/projected/ae879d0a-dc8a-43a4-a764-bd6bf873eaf0-kube-api-access-tdrjh\") pod \"volume-data-source-validator-7598fd5bd-fl6z6\" (UID: \"ae879d0a-dc8a-43a4-a764-bd6bf873eaf0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" Jun 02 01:24:42.657216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.657098 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/370bb775-0ebd-495e-b42e-d92a9c89c419-service-ca-bundle\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.657216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.657125 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chmf4\" (UniqueName: \"kubernetes.io/projected/370bb775-0ebd-495e-b42e-d92a9c89c419-kube-api-access-chmf4\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.657216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.657156 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6mk\" (UniqueName: \"kubernetes.io/projected/b36740ed-c338-43c2-a469-a9b3863700d8-kube-api-access-sh6mk\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.657216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.657179 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/370bb775-0ebd-495e-b42e-d92a9c89c419-snapshots\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.757418 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757396 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/370bb775-0ebd-495e-b42e-d92a9c89c419-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.757545 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757421 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/370bb775-0ebd-495e-b42e-d92a9c89c419-serving-cert\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.757545 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757440 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b36740ed-c338-43c2-a469-a9b3863700d8-config\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.757545 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757454 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b36740ed-c338-43c2-a469-a9b3863700d8-serving-cert\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.757545 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757472 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81be2234-eadc-4bd8-bc01-0b21cdba80cc-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.757545 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757499 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cf38036-924d-44f6-aac1-a2a83b04d5c5-config\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.757801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757553 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cf38036-924d-44f6-aac1-a2a83b04d5c5-serving-cert\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.757801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757605 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/3cf38036-924d-44f6-aac1-a2a83b04d5c5-kube-api-access-7hkqw\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.757801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757653 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b36740ed-c338-43c2-a469-a9b3863700d8-trusted-ca\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.757801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757693 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tdrjh\" (UniqueName: \"kubernetes.io/projected/ae879d0a-dc8a-43a4-a764-bd6bf873eaf0-kube-api-access-tdrjh\") pod \"volume-data-source-validator-7598fd5bd-fl6z6\" (UID: \"ae879d0a-dc8a-43a4-a764-bd6bf873eaf0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" Jun 02 01:24:42.757801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757747 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81be2234-eadc-4bd8-bc01-0b21cdba80cc-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.757801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757779 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfnt\" (UniqueName: \"kubernetes.io/projected/81be2234-eadc-4bd8-bc01-0b21cdba80cc-kube-api-access-qtfnt\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.758082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757812 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/370bb775-0ebd-495e-b42e-d92a9c89c419-service-ca-bundle\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.758082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757842 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chmf4\" (UniqueName: \"kubernetes.io/projected/370bb775-0ebd-495e-b42e-d92a9c89c419-kube-api-access-chmf4\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.758082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757893 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6mk\" (UniqueName: \"kubernetes.io/projected/b36740ed-c338-43c2-a469-a9b3863700d8-kube-api-access-sh6mk\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.758082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757919 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/370bb775-0ebd-495e-b42e-d92a9c89c419-snapshots\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.758082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.757994 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/370bb775-0ebd-495e-b42e-d92a9c89c419-tmp\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.758769 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.758246 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b36740ed-c338-43c2-a469-a9b3863700d8-config\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.758769 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.758254 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cf38036-924d-44f6-aac1-a2a83b04d5c5-config\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.758769 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.758590 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/370bb775-0ebd-495e-b42e-d92a9c89c419-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.758769 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.758665 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b36740ed-c338-43c2-a469-a9b3863700d8-trusted-ca\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.758769 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.758717 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/370bb775-0ebd-495e-b42e-d92a9c89c419-tmp\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.759051 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.758911 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/370bb775-0ebd-495e-b42e-d92a9c89c419-service-ca-bundle\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.759168 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.759077 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/370bb775-0ebd-495e-b42e-d92a9c89c419-snapshots\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.760105 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.760078 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/370bb775-0ebd-495e-b42e-d92a9c89c419-serving-cert\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.760226 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.760205 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b36740ed-c338-43c2-a469-a9b3863700d8-serving-cert\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.760642 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.760623 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cf38036-924d-44f6-aac1-a2a83b04d5c5-serving-cert\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.766016 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.765992 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6mk\" (UniqueName: \"kubernetes.io/projected/b36740ed-c338-43c2-a469-a9b3863700d8-kube-api-access-sh6mk\") pod \"console-operator-86d7c6cc77-85f4s\" (UID: \"b36740ed-c338-43c2-a469-a9b3863700d8\") " pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.766111 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.766085 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chmf4\" (UniqueName: \"kubernetes.io/projected/370bb775-0ebd-495e-b42e-d92a9c89c419-kube-api-access-chmf4\") pod \"insights-operator-788bf58df5-96x9s\" (UID: \"370bb775-0ebd-495e-b42e-d92a9c89c419\") " pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.766218 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.766199 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hkqw\" (UniqueName: \"kubernetes.io/projected/3cf38036-924d-44f6-aac1-a2a83b04d5c5-kube-api-access-7hkqw\") pod \"service-ca-operator-69877444c-fzjwq\" (UID: \"3cf38036-924d-44f6-aac1-a2a83b04d5c5\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.766340 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.766313 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdrjh\" (UniqueName: \"kubernetes.io/projected/ae879d0a-dc8a-43a4-a764-bd6bf873eaf0-kube-api-access-tdrjh\") pod \"volume-data-source-validator-7598fd5bd-fl6z6\" (UID: \"ae879d0a-dc8a-43a4-a764-bd6bf873eaf0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" Jun 02 01:24:42.836296 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.836231 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" Jun 02 01:24:42.846889 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.846869 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-96x9s" Jun 02 01:24:42.851590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.851572 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:42.858279 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.858254 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81be2234-eadc-4bd8-bc01-0b21cdba80cc-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.858387 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.858312 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81be2234-eadc-4bd8-bc01-0b21cdba80cc-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.858387 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.858343 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfnt\" (UniqueName: \"kubernetes.io/projected/81be2234-eadc-4bd8-bc01-0b21cdba80cc-kube-api-access-qtfnt\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.858937 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.858909 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81be2234-eadc-4bd8-bc01-0b21cdba80cc-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.860957 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.860932 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81be2234-eadc-4bd8-bc01-0b21cdba80cc-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.867719 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.867668 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfnt\" (UniqueName: \"kubernetes.io/projected/81be2234-eadc-4bd8-bc01-0b21cdba80cc-kube-api-access-qtfnt\") pod \"kube-storage-version-migrator-operator-96ddc787c-df7v8\" (UID: \"81be2234-eadc-4bd8-bc01-0b21cdba80cc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.933604 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.933417 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" Jun 02 01:24:42.939981 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.939956 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" Jun 02 01:24:42.979796 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:42.979741 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6"] Jun 02 01:24:42.983608 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:24:42.983571 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae879d0a_dc8a_43a4_a764_bd6bf873eaf0.slice/crio-e04392c5799a8ea26f4fdc390ebbfc9e1159d89e561f76ed06cedcb72c525c0e WatchSource:0}: Error finding container e04392c5799a8ea26f4fdc390ebbfc9e1159d89e561f76ed06cedcb72c525c0e: Status 404 returned error can't find the container with id e04392c5799a8ea26f4fdc390ebbfc9e1159d89e561f76ed06cedcb72c525c0e Jun 02 01:24:43.074025 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.073997 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8"] Jun 02 01:24:43.076887 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:24:43.076864 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81be2234_eadc_4bd8_bc01_0b21cdba80cc.slice/crio-a1ad798fdbec2be8296163bc68ed018ed1815d8e9be83c6f9c225a84241c97ab WatchSource:0}: Error finding container a1ad798fdbec2be8296163bc68ed018ed1815d8e9be83c6f9c225a84241c97ab: Status 404 returned error can't find the container with id a1ad798fdbec2be8296163bc68ed018ed1815d8e9be83c6f9c225a84241c97ab Jun 02 01:24:43.087338 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.087288 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq"] Jun 02 01:24:43.089592 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:24:43.089569 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf38036_924d_44f6_aac1_a2a83b04d5c5.slice/crio-2632b65b4226aa767ee06c0fa34dcb0bb71a1f6c7adcfc3a95ceb1df9d009135 WatchSource:0}: Error finding container 2632b65b4226aa767ee06c0fa34dcb0bb71a1f6c7adcfc3a95ceb1df9d009135: Status 404 returned error can't find the container with id 2632b65b4226aa767ee06c0fa34dcb0bb71a1f6c7adcfc3a95ceb1df9d009135 Jun 02 01:24:43.203453 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.203426 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-96x9s"] Jun 02 01:24:43.206003 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.205979 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-85f4s"] Jun 02 01:24:43.206307 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:24:43.206278 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod370bb775_0ebd_495e_b42e_d92a9c89c419.slice/crio-cf97077c432cabba29f23f3692ef1af4828790b002db7680ca46a05324d9c9c4 WatchSource:0}: Error finding container cf97077c432cabba29f23f3692ef1af4828790b002db7680ca46a05324d9c9c4: Status 404 returned error can't find the container with id cf97077c432cabba29f23f3692ef1af4828790b002db7680ca46a05324d9c9c4 Jun 02 01:24:43.208691 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:24:43.208677 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36740ed_c338_43c2_a469_a9b3863700d8.slice/crio-e37b3ab7eaef8f4d9d8eb4e90147b5193bac87e1b56ad5281b1e37ab96493498 WatchSource:0}: Error finding container e37b3ab7eaef8f4d9d8eb4e90147b5193bac87e1b56ad5281b1e37ab96493498: Status 404 returned error can't find the container with id e37b3ab7eaef8f4d9d8eb4e90147b5193bac87e1b56ad5281b1e37ab96493498 Jun 02 01:24:43.323300 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.323259 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" event={"ID":"b36740ed-c338-43c2-a469-a9b3863700d8","Type":"ContainerStarted","Data":"e37b3ab7eaef8f4d9d8eb4e90147b5193bac87e1b56ad5281b1e37ab96493498"} Jun 02 01:24:43.324180 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.324160 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" event={"ID":"3cf38036-924d-44f6-aac1-a2a83b04d5c5","Type":"ContainerStarted","Data":"2632b65b4226aa767ee06c0fa34dcb0bb71a1f6c7adcfc3a95ceb1df9d009135"} Jun 02 01:24:43.325060 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.325040 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-96x9s" event={"ID":"370bb775-0ebd-495e-b42e-d92a9c89c419","Type":"ContainerStarted","Data":"cf97077c432cabba29f23f3692ef1af4828790b002db7680ca46a05324d9c9c4"} Jun 02 01:24:43.325973 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.325948 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" event={"ID":"ae879d0a-dc8a-43a4-a764-bd6bf873eaf0","Type":"ContainerStarted","Data":"e04392c5799a8ea26f4fdc390ebbfc9e1159d89e561f76ed06cedcb72c525c0e"} Jun 02 01:24:43.326867 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:43.326846 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" event={"ID":"81be2234-eadc-4bd8-bc01-0b21cdba80cc","Type":"ContainerStarted","Data":"a1ad798fdbec2be8296163bc68ed018ed1815d8e9be83c6f9c225a84241c97ab"} Jun 02 01:24:45.991561 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:45.991515 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p"] Jun 02 01:24:45.994773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:45.994759 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" Jun 02 01:24:45.996964 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:45.996943 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vzvcv\"" Jun 02 01:24:46.035604 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:46.035581 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p"] Jun 02 01:24:46.084099 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:46.084072 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6q7r\" (UniqueName: \"kubernetes.io/projected/4013d552-4e2d-4f46-b4d5-39bd52f176c7-kube-api-access-v6q7r\") pod \"network-check-source-56d84b9f44-lvp5p\" (UID: \"4013d552-4e2d-4f46-b4d5-39bd52f176c7\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" Jun 02 01:24:46.185189 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:46.185149 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6q7r\" (UniqueName: \"kubernetes.io/projected/4013d552-4e2d-4f46-b4d5-39bd52f176c7-kube-api-access-v6q7r\") pod \"network-check-source-56d84b9f44-lvp5p\" (UID: \"4013d552-4e2d-4f46-b4d5-39bd52f176c7\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" Jun 02 01:24:46.193829 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:46.193801 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6q7r\" (UniqueName: \"kubernetes.io/projected/4013d552-4e2d-4f46-b4d5-39bd52f176c7-kube-api-access-v6q7r\") pod \"network-check-source-56d84b9f44-lvp5p\" (UID: \"4013d552-4e2d-4f46-b4d5-39bd52f176c7\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" Jun 02 01:24:46.303776 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:46.303701 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" Jun 02 01:24:47.164869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.164824 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p"] Jun 02 01:24:47.342276 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.342235 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-96x9s" event={"ID":"370bb775-0ebd-495e-b42e-d92a9c89c419","Type":"ContainerStarted","Data":"9913376c8ce4f8163416099430284239bcf69c31c4798489f08442fe55ca30e2"} Jun 02 01:24:47.344066 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.344028 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" event={"ID":"ae879d0a-dc8a-43a4-a764-bd6bf873eaf0","Type":"ContainerStarted","Data":"cf442fa02c4616b7e723e613e62a48f62b30c6610cc062d8f7dd3d8507cde1d4"} Jun 02 01:24:47.345451 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.345396 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" event={"ID":"4013d552-4e2d-4f46-b4d5-39bd52f176c7","Type":"ContainerStarted","Data":"04e76becf1bcb0b148a612ef9334f5be46c76881cda799a1f3e96ce5ac865aa6"} Jun 02 01:24:47.345451 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.345426 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" event={"ID":"4013d552-4e2d-4f46-b4d5-39bd52f176c7","Type":"ContainerStarted","Data":"74e1451459364673c18520d6d447e877576ae8498b2f1585e11081b4b93d1c48"} Jun 02 01:24:47.347368 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.347344 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" event={"ID":"81be2234-eadc-4bd8-bc01-0b21cdba80cc","Type":"ContainerStarted","Data":"958ac7e08cd44846e994b04248f16d3aa78599b32d14a4d03765febea0bc9e01"} Jun 02 01:24:47.348730 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.348713 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/0.log" Jun 02 01:24:47.348798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.348748 2609 generic.go:358] "Generic (PLEG): container finished" podID="b36740ed-c338-43c2-a469-a9b3863700d8" containerID="bcf8daef34b94eb5a4def700416a80a0f245b99163e84d5e3429b929d73e9984" exitCode=255 Jun 02 01:24:47.348854 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.348819 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" event={"ID":"b36740ed-c338-43c2-a469-a9b3863700d8","Type":"ContainerDied","Data":"bcf8daef34b94eb5a4def700416a80a0f245b99163e84d5e3429b929d73e9984"} Jun 02 01:24:47.349030 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.349015 2609 scope.go:117] "RemoveContainer" containerID="bcf8daef34b94eb5a4def700416a80a0f245b99163e84d5e3429b929d73e9984" Jun 02 01:24:47.350670 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.350650 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" event={"ID":"3cf38036-924d-44f6-aac1-a2a83b04d5c5","Type":"ContainerStarted","Data":"8b743f47a48b97990a33a02b3f9eb5a74c4bfb40c66fc29558e5d7e4f6ad81b2"} Jun 02 01:24:47.375709 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.374921 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-96x9s" podStartSLOduration=1.5735670800000001 podStartE2EDuration="5.374906772s" podCreationTimestamp="2026-06-02 01:24:42 +0000 UTC" firstStartedPulling="2026-06-02 01:24:43.208332334 +0000 UTC m=+110.903254614" lastFinishedPulling="2026-06-02 01:24:47.009672026 +0000 UTC m=+114.704594306" observedRunningTime="2026-06-02 01:24:47.360431561 +0000 UTC m=+115.055353863" watchObservedRunningTime="2026-06-02 01:24:47.374906772 +0000 UTC m=+115.069829074" Jun 02 01:24:47.393278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.392614 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-fl6z6" podStartSLOduration=1.369079724 podStartE2EDuration="5.392600386s" podCreationTimestamp="2026-06-02 01:24:42 +0000 UTC" firstStartedPulling="2026-06-02 01:24:42.986070336 +0000 UTC m=+110.680992617" lastFinishedPulling="2026-06-02 01:24:47.009590987 +0000 UTC m=+114.704513279" observedRunningTime="2026-06-02 01:24:47.37557663 +0000 UTC m=+115.070498935" watchObservedRunningTime="2026-06-02 01:24:47.392600386 +0000 UTC m=+115.087522689" Jun 02 01:24:47.407749 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.407700 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" podStartSLOduration=1.481814975 podStartE2EDuration="5.407685953s" podCreationTimestamp="2026-06-02 01:24:42 +0000 UTC" firstStartedPulling="2026-06-02 01:24:43.09116891 +0000 UTC m=+110.786091193" lastFinishedPulling="2026-06-02 01:24:47.017039877 +0000 UTC m=+114.711962171" observedRunningTime="2026-06-02 01:24:47.406579445 +0000 UTC m=+115.101501748" watchObservedRunningTime="2026-06-02 01:24:47.407685953 +0000 UTC m=+115.102608255" Jun 02 01:24:47.425301 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.425258 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-lvp5p" podStartSLOduration=2.425242774 podStartE2EDuration="2.425242774s" podCreationTimestamp="2026-06-02 01:24:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:24:47.424009805 +0000 UTC m=+115.118932107" watchObservedRunningTime="2026-06-02 01:24:47.425242774 +0000 UTC m=+115.120165077" Jun 02 01:24:47.443512 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:47.443470 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" podStartSLOduration=1.510264891 podStartE2EDuration="5.443459607s" podCreationTimestamp="2026-06-02 01:24:42 +0000 UTC" firstStartedPulling="2026-06-02 01:24:43.078750288 +0000 UTC m=+110.773672570" lastFinishedPulling="2026-06-02 01:24:47.011944993 +0000 UTC m=+114.706867286" observedRunningTime="2026-06-02 01:24:47.443258051 +0000 UTC m=+115.138180353" watchObservedRunningTime="2026-06-02 01:24:47.443459607 +0000 UTC m=+115.138381908" Jun 02 01:24:48.354794 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.354766 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:24:48.355344 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.355125 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/0.log" Jun 02 01:24:48.355344 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.355159 2609 generic.go:358] "Generic (PLEG): container finished" podID="b36740ed-c338-43c2-a469-a9b3863700d8" containerID="c5de17e86d922587540aca6cf175c2cffec9e5673accbac1e4ccb240888ad98a" exitCode=255 Jun 02 01:24:48.355344 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.355273 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" event={"ID":"b36740ed-c338-43c2-a469-a9b3863700d8","Type":"ContainerDied","Data":"c5de17e86d922587540aca6cf175c2cffec9e5673accbac1e4ccb240888ad98a"} Jun 02 01:24:48.355344 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.355325 2609 scope.go:117] "RemoveContainer" containerID="bcf8daef34b94eb5a4def700416a80a0f245b99163e84d5e3429b929d73e9984" Jun 02 01:24:48.355593 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.355545 2609 scope.go:117] "RemoveContainer" containerID="c5de17e86d922587540aca6cf175c2cffec9e5673accbac1e4ccb240888ad98a" Jun 02 01:24:48.355767 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:24:48.355743 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-85f4s_openshift-console-operator(b36740ed-c338-43c2-a469-a9b3863700d8)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" podUID="b36740ed-c338-43c2-a469-a9b3863700d8" Jun 02 01:24:48.597394 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.597362 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl"] Jun 02 01:24:48.601490 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.601476 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" Jun 02 01:24:48.603738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.603719 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 01:24:48.603855 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.603836 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zzl5h\"" Jun 02 01:24:48.603914 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.603900 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 01:24:48.608496 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.608135 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl"] Jun 02 01:24:48.706669 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.706647 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqdb5\" (UniqueName: \"kubernetes.io/projected/b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a-kube-api-access-hqdb5\") pod \"migrator-96c6f749-x2szl\" (UID: \"b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" Jun 02 01:24:48.807236 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.807211 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqdb5\" (UniqueName: \"kubernetes.io/projected/b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a-kube-api-access-hqdb5\") pod \"migrator-96c6f749-x2szl\" (UID: \"b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" Jun 02 01:24:48.817093 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.817065 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqdb5\" (UniqueName: \"kubernetes.io/projected/b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a-kube-api-access-hqdb5\") pod \"migrator-96c6f749-x2szl\" (UID: \"b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" Jun 02 01:24:48.910866 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:48.910810 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" Jun 02 01:24:49.029653 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:49.029626 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl"] Jun 02 01:24:49.032486 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:24:49.032461 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a58663_a2ea_4b1e_8f9e_9a5ffec12c0a.slice/crio-40c4bf519cbe911f0296981f1f88c4b69d59419991e55d0b3e1b473d0a757123 WatchSource:0}: Error finding container 40c4bf519cbe911f0296981f1f88c4b69d59419991e55d0b3e1b473d0a757123: Status 404 returned error can't find the container with id 40c4bf519cbe911f0296981f1f88c4b69d59419991e55d0b3e1b473d0a757123 Jun 02 01:24:49.358850 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:49.358809 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" event={"ID":"b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a","Type":"ContainerStarted","Data":"40c4bf519cbe911f0296981f1f88c4b69d59419991e55d0b3e1b473d0a757123"} Jun 02 01:24:49.360001 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:49.359981 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:24:49.360328 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:49.360314 2609 scope.go:117] "RemoveContainer" containerID="c5de17e86d922587540aca6cf175c2cffec9e5673accbac1e4ccb240888ad98a" Jun 02 01:24:49.360482 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:24:49.360467 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-85f4s_openshift-console-operator(b36740ed-c338-43c2-a469-a9b3863700d8)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" podUID="b36740ed-c338-43c2-a469-a9b3863700d8" Jun 02 01:24:49.957894 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:49.957867 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7skf_34271d8f-db17-455f-a495-36c129fa4e43/dns-node-resolver/0.log" Jun 02 01:24:50.740559 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.740481 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-lbzmz"] Jun 02 01:24:50.743215 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.743199 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.745512 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.745495 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 02 01:24:50.745638 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.745513 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-cnrft\"" Jun 02 01:24:50.746281 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.746259 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 02 01:24:50.746351 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.746342 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 02 01:24:50.746409 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.746386 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 02 01:24:50.751467 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.751448 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-lbzmz"] Jun 02 01:24:50.821579 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.821547 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bf8629e4-f906-4b52-99e4-c07ec64a1af0-signing-cabundle\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.821682 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.821597 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bf8629e4-f906-4b52-99e4-c07ec64a1af0-signing-key\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.821682 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.821670 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ldhh\" (UniqueName: \"kubernetes.io/projected/bf8629e4-f906-4b52-99e4-c07ec64a1af0-kube-api-access-2ldhh\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.922671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.922645 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bf8629e4-f906-4b52-99e4-c07ec64a1af0-signing-cabundle\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.922760 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.922682 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bf8629e4-f906-4b52-99e4-c07ec64a1af0-signing-key\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.922760 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.922706 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ldhh\" (UniqueName: \"kubernetes.io/projected/bf8629e4-f906-4b52-99e4-c07ec64a1af0-kube-api-access-2ldhh\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.923306 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.923285 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/bf8629e4-f906-4b52-99e4-c07ec64a1af0-signing-cabundle\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.925087 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.925060 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/bf8629e4-f906-4b52-99e4-c07ec64a1af0-signing-key\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:50.931122 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:50.931101 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ldhh\" (UniqueName: \"kubernetes.io/projected/bf8629e4-f906-4b52-99e4-c07ec64a1af0-kube-api-access-2ldhh\") pod \"service-ca-685df94d57-lbzmz\" (UID: \"bf8629e4-f906-4b52-99e4-c07ec64a1af0\") " pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:51.051865 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.051804 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-lbzmz" Jun 02 01:24:51.158653 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.158631 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m9xgw_9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1/node-ca/0.log" Jun 02 01:24:51.167819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.167726 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-lbzmz"] Jun 02 01:24:51.170254 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:24:51.170227 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8629e4_f906_4b52_99e4_c07ec64a1af0.slice/crio-24dd42c5d419e4c91b6d63ecdc5252da6035d8cd008eee98934d1756af77be18 WatchSource:0}: Error finding container 24dd42c5d419e4c91b6d63ecdc5252da6035d8cd008eee98934d1756af77be18: Status 404 returned error can't find the container with id 24dd42c5d419e4c91b6d63ecdc5252da6035d8cd008eee98934d1756af77be18 Jun 02 01:24:51.368025 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.367945 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-lbzmz" event={"ID":"bf8629e4-f906-4b52-99e4-c07ec64a1af0","Type":"ContainerStarted","Data":"b0286e38828689b48ac483aa44a4c0c9e12767e499c048a9f218c2bb77bf5dff"} Jun 02 01:24:51.368025 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.367990 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-lbzmz" event={"ID":"bf8629e4-f906-4b52-99e4-c07ec64a1af0","Type":"ContainerStarted","Data":"24dd42c5d419e4c91b6d63ecdc5252da6035d8cd008eee98934d1756af77be18"} Jun 02 01:24:51.369514 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.369490 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" event={"ID":"b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a","Type":"ContainerStarted","Data":"f14fca6545881be5e0ff95b3a80b1bca1548c808591c2760bc5ba08b56c8c22b"} Jun 02 01:24:51.369514 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.369535 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" event={"ID":"b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a","Type":"ContainerStarted","Data":"31023250baec8f0410d09c5c2627b91a7fe4951a0cc9675feb819b4b0d90be8e"} Jun 02 01:24:51.385586 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.385546 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-lbzmz" podStartSLOduration=1.385509635 podStartE2EDuration="1.385509635s" podCreationTimestamp="2026-06-02 01:24:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:24:51.384201951 +0000 UTC m=+119.079124252" watchObservedRunningTime="2026-06-02 01:24:51.385509635 +0000 UTC m=+119.080431937" Jun 02 01:24:51.404300 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:51.404256 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-x2szl" podStartSLOduration=1.961445657 podStartE2EDuration="3.404245525s" podCreationTimestamp="2026-06-02 01:24:48 +0000 UTC" firstStartedPulling="2026-06-02 01:24:49.034783446 +0000 UTC m=+116.729705739" lastFinishedPulling="2026-06-02 01:24:50.477583323 +0000 UTC m=+118.172505607" observedRunningTime="2026-06-02 01:24:51.399481662 +0000 UTC m=+119.094403963" watchObservedRunningTime="2026-06-02 01:24:51.404245525 +0000 UTC m=+119.099167829" Jun 02 01:24:52.852212 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:52.852181 2609 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:52.852212 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:52.852216 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:24:52.852737 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:24:52.852548 2609 scope.go:117] "RemoveContainer" containerID="c5de17e86d922587540aca6cf175c2cffec9e5673accbac1e4ccb240888ad98a" Jun 02 01:24:52.852737 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:24:52.852689 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-85f4s_openshift-console-operator(b36740ed-c338-43c2-a469-a9b3863700d8)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" podUID="b36740ed-c338-43c2-a469-a9b3863700d8" Jun 02 01:25:02.604180 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:02.604144 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:25:02.606488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:02.606439 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c24605d8-ee39-4c34-a643-e2fca2ffa4ed-metrics-certs\") pod \"network-metrics-daemon-w9s4l\" (UID: \"c24605d8-ee39-4c34-a643-e2fca2ffa4ed\") " pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:25:02.752819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:02.752788 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jprs5\"" Jun 02 01:25:02.760578 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:02.760559 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w9s4l" Jun 02 01:25:02.885751 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:02.885678 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w9s4l"] Jun 02 01:25:02.888758 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:02.888731 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24605d8_ee39_4c34_a643_e2fca2ffa4ed.slice/crio-faf65c7ac003dd46e304061fcbd71214cf507ff2a2af16af82d67adff72954e5 WatchSource:0}: Error finding container faf65c7ac003dd46e304061fcbd71214cf507ff2a2af16af82d67adff72954e5: Status 404 returned error can't find the container with id faf65c7ac003dd46e304061fcbd71214cf507ff2a2af16af82d67adff72954e5 Jun 02 01:25:03.403096 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:03.403048 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9s4l" event={"ID":"c24605d8-ee39-4c34-a643-e2fca2ffa4ed","Type":"ContainerStarted","Data":"faf65c7ac003dd46e304061fcbd71214cf507ff2a2af16af82d67adff72954e5"} Jun 02 01:25:04.407703 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:04.407670 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9s4l" event={"ID":"c24605d8-ee39-4c34-a643-e2fca2ffa4ed","Type":"ContainerStarted","Data":"11e12bccd71a07dc0f8a9895c67091128fb0d40fbe067e751b53c325ba0de36a"} Jun 02 01:25:04.932640 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:04.932609 2609 scope.go:117] "RemoveContainer" containerID="c5de17e86d922587540aca6cf175c2cffec9e5673accbac1e4ccb240888ad98a" Jun 02 01:25:05.412216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:05.412143 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:25:05.412668 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:05.412231 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" event={"ID":"b36740ed-c338-43c2-a469-a9b3863700d8","Type":"ContainerStarted","Data":"9e1d89f7272f31fc88ab46ac7401a0f726b83bd174e4d1cf9ba08f810e9f91be"} Jun 02 01:25:05.412668 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:05.412518 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:25:05.413987 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:05.413959 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w9s4l" event={"ID":"c24605d8-ee39-4c34-a643-e2fca2ffa4ed","Type":"ContainerStarted","Data":"a80dd1b54b728a0de617448306d91d274faf55847ba7cc07ce7c6aea5aa2c656"} Jun 02 01:25:05.428090 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:05.428048 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" podStartSLOduration=19.627019828999998 podStartE2EDuration="23.428039599s" podCreationTimestamp="2026-06-02 01:24:42 +0000 UTC" firstStartedPulling="2026-06-02 01:24:43.210404227 +0000 UTC m=+110.905326509" lastFinishedPulling="2026-06-02 01:24:47.011423994 +0000 UTC m=+114.706346279" observedRunningTime="2026-06-02 01:25:05.426836229 +0000 UTC m=+133.121758530" watchObservedRunningTime="2026-06-02 01:25:05.428039599 +0000 UTC m=+133.122961901" Jun 02 01:25:05.441054 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:05.441016 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w9s4l" podStartSLOduration=131.019409374 podStartE2EDuration="2m12.441005817s" podCreationTimestamp="2026-06-02 01:22:53 +0000 UTC" firstStartedPulling="2026-06-02 01:25:02.890796237 +0000 UTC m=+130.585718517" lastFinishedPulling="2026-06-02 01:25:04.312392677 +0000 UTC m=+132.007314960" observedRunningTime="2026-06-02 01:25:05.440108384 +0000 UTC m=+133.135030687" watchObservedRunningTime="2026-06-02 01:25:05.441005817 +0000 UTC m=+133.135928118" Jun 02 01:25:05.813601 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:05.813574 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-85f4s" Jun 02 01:25:09.963396 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:09.963364 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h2tjs"] Jun 02 01:25:09.967106 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:09.966996 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:09.970652 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:09.970629 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:25:09.970748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:09.970629 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cxmpn\"" Jun 02 01:25:09.971746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:09.971728 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:25:09.974443 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:09.974423 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h2tjs"] Jun 02 01:25:10.055984 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.055954 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26b6de66-dd09-47f8-82fb-53bd63dd9622-crio-socket\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.056107 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.055998 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26b6de66-dd09-47f8-82fb-53bd63dd9622-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.056149 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.056134 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26b6de66-dd09-47f8-82fb-53bd63dd9622-data-volume\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.056183 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.056159 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvkfb\" (UniqueName: \"kubernetes.io/projected/26b6de66-dd09-47f8-82fb-53bd63dd9622-kube-api-access-lvkfb\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.056222 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.056189 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26b6de66-dd09-47f8-82fb-53bd63dd9622-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.156901 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.156871 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26b6de66-dd09-47f8-82fb-53bd63dd9622-crio-socket\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.156901 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.156903 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26b6de66-dd09-47f8-82fb-53bd63dd9622-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.157083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.156944 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26b6de66-dd09-47f8-82fb-53bd63dd9622-data-volume\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.157083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.156960 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lvkfb\" (UniqueName: \"kubernetes.io/projected/26b6de66-dd09-47f8-82fb-53bd63dd9622-kube-api-access-lvkfb\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.157083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.156989 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26b6de66-dd09-47f8-82fb-53bd63dd9622-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.157083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.157025 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26b6de66-dd09-47f8-82fb-53bd63dd9622-crio-socket\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.157338 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.157319 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26b6de66-dd09-47f8-82fb-53bd63dd9622-data-volume\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.157474 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.157458 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26b6de66-dd09-47f8-82fb-53bd63dd9622-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.159495 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.159475 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26b6de66-dd09-47f8-82fb-53bd63dd9622-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.169769 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.169744 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvkfb\" (UniqueName: \"kubernetes.io/projected/26b6de66-dd09-47f8-82fb-53bd63dd9622-kube-api-access-lvkfb\") pod \"insights-runtime-extractor-h2tjs\" (UID: \"26b6de66-dd09-47f8-82fb-53bd63dd9622\") " pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.278600 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.278546 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h2tjs" Jun 02 01:25:10.401074 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.401046 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h2tjs"] Jun 02 01:25:10.404309 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:10.404280 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b6de66_dd09_47f8_82fb_53bd63dd9622.slice/crio-064b0ff8d1f60d689c5e0fb2dbb701db68af2b00e8c0ba8a699f791fab9a637f WatchSource:0}: Error finding container 064b0ff8d1f60d689c5e0fb2dbb701db68af2b00e8c0ba8a699f791fab9a637f: Status 404 returned error can't find the container with id 064b0ff8d1f60d689c5e0fb2dbb701db68af2b00e8c0ba8a699f791fab9a637f Jun 02 01:25:10.429212 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:10.429183 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2tjs" event={"ID":"26b6de66-dd09-47f8-82fb-53bd63dd9622","Type":"ContainerStarted","Data":"064b0ff8d1f60d689c5e0fb2dbb701db68af2b00e8c0ba8a699f791fab9a637f"} Jun 02 01:25:11.433331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:11.433300 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2tjs" event={"ID":"26b6de66-dd09-47f8-82fb-53bd63dd9622","Type":"ContainerStarted","Data":"d9b8f0bd08e3e66cf1cc9e86c8c666bdfe102c6015c1597fa0708ea5bcf346a4"} Jun 02 01:25:11.433331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:11.433334 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2tjs" event={"ID":"26b6de66-dd09-47f8-82fb-53bd63dd9622","Type":"ContainerStarted","Data":"c1f4126a4ecebe2288e8abdcc2b55e2fd668d7153bc80f7acbaf57b3dee6d9c1"} Jun 02 01:25:13.440212 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:13.440178 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h2tjs" event={"ID":"26b6de66-dd09-47f8-82fb-53bd63dd9622","Type":"ContainerStarted","Data":"7c925af42b261c818cba89559803aa8d16ad4091334f778a920d97f1c4824773"} Jun 02 01:25:13.457978 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:13.457935 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h2tjs" podStartSLOduration=1.847646753 podStartE2EDuration="4.457922005s" podCreationTimestamp="2026-06-02 01:25:09 +0000 UTC" firstStartedPulling="2026-06-02 01:25:10.465546174 +0000 UTC m=+138.160468456" lastFinishedPulling="2026-06-02 01:25:13.075821413 +0000 UTC m=+140.770743708" observedRunningTime="2026-06-02 01:25:13.456838199 +0000 UTC m=+141.151760502" watchObservedRunningTime="2026-06-02 01:25:13.457922005 +0000 UTC m=+141.152844306" Jun 02 01:25:15.511146 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.511110 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-876dc74df-7226m"] Jun 02 01:25:15.514757 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.514739 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.517999 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.517976 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 02 01:25:15.518131 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.518016 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 02 01:25:15.518131 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.518087 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:25:15.518131 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.518019 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 02 01:25:15.518131 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.518126 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b8mxz\"" Jun 02 01:25:15.518417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.518126 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 02 01:25:15.518417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.518113 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 02 01:25:15.518417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.518195 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:25:15.523500 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.523464 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-876dc74df-7226m"] Jun 02 01:25:15.595410 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.595384 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-serving-cert\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.595410 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.595410 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-service-ca\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.595620 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.595428 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprmw\" (UniqueName: \"kubernetes.io/projected/28a01ce7-4f3e-4e93-8241-989c52da77b0-kube-api-access-fprmw\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.595620 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.595487 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-config\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.595620 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.595506 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-oauth-config\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.595712 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.595616 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-oauth-serving-cert\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.696708 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.696682 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-config\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.696807 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.696713 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-oauth-config\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.696807 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.696759 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-oauth-serving-cert\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.696807 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.696786 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-serving-cert\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.696807 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.696801 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-service-ca\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.696984 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.696816 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fprmw\" (UniqueName: \"kubernetes.io/projected/28a01ce7-4f3e-4e93-8241-989c52da77b0-kube-api-access-fprmw\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.697355 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.697327 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-config\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.697500 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.697470 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-service-ca\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.697500 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.697470 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-oauth-serving-cert\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.699341 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.699314 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-oauth-config\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.699447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.699392 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-serving-cert\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.710365 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.710344 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprmw\" (UniqueName: \"kubernetes.io/projected/28a01ce7-4f3e-4e93-8241-989c52da77b0-kube-api-access-fprmw\") pod \"console-876dc74df-7226m\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.823945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.823880 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:15.947488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:15.947428 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-876dc74df-7226m"] Jun 02 01:25:15.950004 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:15.949974 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a01ce7_4f3e_4e93_8241_989c52da77b0.slice/crio-73ce291cabe680fdcbcf2fd1a8f7c50d0682ba143ab221b2b228b271791c5bd8 WatchSource:0}: Error finding container 73ce291cabe680fdcbcf2fd1a8f7c50d0682ba143ab221b2b228b271791c5bd8: Status 404 returned error can't find the container with id 73ce291cabe680fdcbcf2fd1a8f7c50d0682ba143ab221b2b228b271791c5bd8 Jun 02 01:25:16.448868 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:16.448832 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc74df-7226m" event={"ID":"28a01ce7-4f3e-4e93-8241-989c52da77b0","Type":"ContainerStarted","Data":"73ce291cabe680fdcbcf2fd1a8f7c50d0682ba143ab221b2b228b271791c5bd8"} Jun 02 01:25:17.302617 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:17.302588 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb"] Jun 02 01:25:17.305852 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:17.305825 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:17.308397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:17.308135 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 01:25:17.308397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:17.308228 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-sm6lx\"" Jun 02 01:25:17.312128 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:17.312106 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb"] Jun 02 01:25:17.408461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:17.408433 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/001edd65-ef3a-4c3b-bb94-61b4bc978914-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zrvzb\" (UID: \"001edd65-ef3a-4c3b-bb94-61b4bc978914\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:17.509390 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:17.509339 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/001edd65-ef3a-4c3b-bb94-61b4bc978914-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zrvzb\" (UID: \"001edd65-ef3a-4c3b-bb94-61b4bc978914\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:17.509583 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:25:17.509511 2609 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:25:17.509761 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:25:17.509611 2609 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/001edd65-ef3a-4c3b-bb94-61b4bc978914-tls-certificates podName:001edd65-ef3a-4c3b-bb94-61b4bc978914 nodeName:}" failed. No retries permitted until 2026-06-02 01:25:18.009588416 +0000 UTC m=+145.704510698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/001edd65-ef3a-4c3b-bb94-61b4bc978914-tls-certificates") pod "prometheus-operator-admission-webhook-59b7f8756b-zrvzb" (UID: "001edd65-ef3a-4c3b-bb94-61b4bc978914") : secret "prometheus-operator-admission-webhook-tls" not found Jun 02 01:25:18.013291 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.013258 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/001edd65-ef3a-4c3b-bb94-61b4bc978914-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zrvzb\" (UID: \"001edd65-ef3a-4c3b-bb94-61b4bc978914\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:18.016136 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.016111 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/001edd65-ef3a-4c3b-bb94-61b4bc978914-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-zrvzb\" (UID: \"001edd65-ef3a-4c3b-bb94-61b4bc978914\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:18.217776 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.217730 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:18.351895 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.351864 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb"] Jun 02 01:25:18.354639 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:18.354611 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001edd65_ef3a_4c3b_bb94_61b4bc978914.slice/crio-667dfecf3ca8ed044d36f3e8a4d4c58e231de916a0b122f05b7f49f0cea16d84 WatchSource:0}: Error finding container 667dfecf3ca8ed044d36f3e8a4d4c58e231de916a0b122f05b7f49f0cea16d84: Status 404 returned error can't find the container with id 667dfecf3ca8ed044d36f3e8a4d4c58e231de916a0b122f05b7f49f0cea16d84 Jun 02 01:25:18.455427 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.455386 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" event={"ID":"001edd65-ef3a-4c3b-bb94-61b4bc978914","Type":"ContainerStarted","Data":"667dfecf3ca8ed044d36f3e8a4d4c58e231de916a0b122f05b7f49f0cea16d84"} Jun 02 01:25:18.498180 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.498146 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bfcf56b68-j4kv8"] Jun 02 01:25:18.501477 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.501457 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.510100 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.510058 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 02 01:25:18.513584 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.513563 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfcf56b68-j4kv8"] Jun 02 01:25:18.619516 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.619438 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-serving-cert\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.619516 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.619500 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-config\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.619753 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.619577 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-service-ca\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.619753 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.619629 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-trusted-ca-bundle\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.619753 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.619676 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-oauth-config\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.619753 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.619728 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psqlm\" (UniqueName: \"kubernetes.io/projected/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-kube-api-access-psqlm\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.619919 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.619769 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-oauth-serving-cert\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.720946 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.720911 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-oauth-serving-cert\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721140 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.720978 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-serving-cert\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721140 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.721020 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-config\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721140 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.721066 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-service-ca\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721140 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.721094 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-trusted-ca-bundle\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721140 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.721122 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-oauth-config\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721405 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.721154 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psqlm\" (UniqueName: \"kubernetes.io/projected/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-kube-api-access-psqlm\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721728 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.721704 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-oauth-serving-cert\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.721904 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.721882 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-config\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.722286 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.722267 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-trusted-ca-bundle\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.722433 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.722414 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-service-ca\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.724255 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.724232 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-oauth-config\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.724415 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.724394 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-serving-cert\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.729933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.729890 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psqlm\" (UniqueName: \"kubernetes.io/projected/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-kube-api-access-psqlm\") pod \"console-6bfcf56b68-j4kv8\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:18.813759 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:18.813730 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:19.576606 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:19.576570 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfcf56b68-j4kv8"] Jun 02 01:25:19.676771 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:19.676740 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1b5b8f_093d_48bd_8ec0_ff2f999b8fbf.slice/crio-9d7a4730024f24a35f50f85e83de6874769d36951f2f9b367ccf89ae8d74ff5b WatchSource:0}: Error finding container 9d7a4730024f24a35f50f85e83de6874769d36951f2f9b367ccf89ae8d74ff5b: Status 404 returned error can't find the container with id 9d7a4730024f24a35f50f85e83de6874769d36951f2f9b367ccf89ae8d74ff5b Jun 02 01:25:20.461960 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:20.461909 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc74df-7226m" event={"ID":"28a01ce7-4f3e-4e93-8241-989c52da77b0","Type":"ContainerStarted","Data":"f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb"} Jun 02 01:25:20.463246 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:20.463222 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfcf56b68-j4kv8" event={"ID":"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf","Type":"ContainerStarted","Data":"5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b"} Jun 02 01:25:20.463246 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:20.463251 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfcf56b68-j4kv8" event={"ID":"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf","Type":"ContainerStarted","Data":"9d7a4730024f24a35f50f85e83de6874769d36951f2f9b367ccf89ae8d74ff5b"} Jun 02 01:25:20.477993 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:20.477954 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-876dc74df-7226m" podStartSLOduration=1.7298227640000001 podStartE2EDuration="5.477941047s" podCreationTimestamp="2026-06-02 01:25:15 +0000 UTC" firstStartedPulling="2026-06-02 01:25:15.951964693 +0000 UTC m=+143.646886976" lastFinishedPulling="2026-06-02 01:25:19.700082967 +0000 UTC m=+147.395005259" observedRunningTime="2026-06-02 01:25:20.476916711 +0000 UTC m=+148.171839014" watchObservedRunningTime="2026-06-02 01:25:20.477941047 +0000 UTC m=+148.172863349" Jun 02 01:25:20.492047 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:20.492012 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6bfcf56b68-j4kv8" podStartSLOduration=2.491988074 podStartE2EDuration="2.491988074s" podCreationTimestamp="2026-06-02 01:25:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:25:20.491586954 +0000 UTC m=+148.186509256" watchObservedRunningTime="2026-06-02 01:25:20.491988074 +0000 UTC m=+148.186910376" Jun 02 01:25:21.466741 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:21.466699 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" event={"ID":"001edd65-ef3a-4c3b-bb94-61b4bc978914","Type":"ContainerStarted","Data":"df59032534d78258cc1cc85e12f67f175f43f7dc3ee9f46d197c32a3ce34a7d2"} Jun 02 01:25:21.467157 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:21.467055 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:21.471438 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:21.471413 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" Jun 02 01:25:21.480724 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:21.480689 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-zrvzb" podStartSLOduration=1.9730554 podStartE2EDuration="4.480677492s" podCreationTimestamp="2026-06-02 01:25:17 +0000 UTC" firstStartedPulling="2026-06-02 01:25:18.35643516 +0000 UTC m=+146.051357442" lastFinishedPulling="2026-06-02 01:25:20.864057249 +0000 UTC m=+148.558979534" observedRunningTime="2026-06-02 01:25:21.479995434 +0000 UTC m=+149.174917737" watchObservedRunningTime="2026-06-02 01:25:21.480677492 +0000 UTC m=+149.175599812" Jun 02 01:25:22.369083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.369048 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb"] Jun 02 01:25:22.384711 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.384678 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb"] Jun 02 01:25:22.384858 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.384775 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.387497 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.387475 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 01:25:22.387622 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.387480 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:25:22.387622 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.387483 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pzfb2\"" Jun 02 01:25:22.387622 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.387487 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 01:25:22.388634 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.388595 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:25:22.388740 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.388673 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:25:22.552909 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.552878 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f17b27c0-9e47-439a-94e0-307d46be6ca1-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.553270 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.552936 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f17b27c0-9e47-439a-94e0-307d46be6ca1-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.553270 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.552956 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f17b27c0-9e47-439a-94e0-307d46be6ca1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.553270 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.553000 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvlfh\" (UniqueName: \"kubernetes.io/projected/f17b27c0-9e47-439a-94e0-307d46be6ca1-kube-api-access-mvlfh\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.654251 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.654150 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvlfh\" (UniqueName: \"kubernetes.io/projected/f17b27c0-9e47-439a-94e0-307d46be6ca1-kube-api-access-mvlfh\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.654251 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.654249 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f17b27c0-9e47-439a-94e0-307d46be6ca1-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.654488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.654324 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f17b27c0-9e47-439a-94e0-307d46be6ca1-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.654488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.654377 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f17b27c0-9e47-439a-94e0-307d46be6ca1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.654986 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.654962 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f17b27c0-9e47-439a-94e0-307d46be6ca1-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.656853 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.656833 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f17b27c0-9e47-439a-94e0-307d46be6ca1-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.656950 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.656859 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f17b27c0-9e47-439a-94e0-307d46be6ca1-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.663354 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.663333 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvlfh\" (UniqueName: \"kubernetes.io/projected/f17b27c0-9e47-439a-94e0-307d46be6ca1-kube-api-access-mvlfh\") pod \"prometheus-operator-658bcd8bdf-zkwhb\" (UID: \"f17b27c0-9e47-439a-94e0-307d46be6ca1\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.694056 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.694032 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" Jun 02 01:25:22.827238 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:22.827213 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb"] Jun 02 01:25:22.829282 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:22.829253 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf17b27c0_9e47_439a_94e0_307d46be6ca1.slice/crio-30a5a593664bedbc350439950f439ce73e34dee880b108937c9654b4860baeb9 WatchSource:0}: Error finding container 30a5a593664bedbc350439950f439ce73e34dee880b108937c9654b4860baeb9: Status 404 returned error can't find the container with id 30a5a593664bedbc350439950f439ce73e34dee880b108937c9654b4860baeb9 Jun 02 01:25:23.474778 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:23.474734 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" event={"ID":"f17b27c0-9e47-439a-94e0-307d46be6ca1","Type":"ContainerStarted","Data":"30a5a593664bedbc350439950f439ce73e34dee880b108937c9654b4860baeb9"} Jun 02 01:25:24.480329 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:24.480288 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" event={"ID":"f17b27c0-9e47-439a-94e0-307d46be6ca1","Type":"ContainerStarted","Data":"cf4301bebffb5cfc3ab30993895afc37207ae89f26053236fae1d4e472a2b14c"} Jun 02 01:25:24.480979 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:24.480336 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" event={"ID":"f17b27c0-9e47-439a-94e0-307d46be6ca1","Type":"ContainerStarted","Data":"cbd90b18fc73a4590ca049f2991d62d71e1f0ac158f19a2966569dbb49601322"} Jun 02 01:25:25.824905 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:25.824871 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:25.825368 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:25.824924 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:25.826035 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:25.826010 2609 patch_prober.go:28] interesting pod/console-876dc74df-7226m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 02 01:25:25.826142 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:25.826053 2609 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-876dc74df-7226m" podUID="28a01ce7-4f3e-4e93-8241-989c52da77b0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 02 01:25:26.708724 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.708663 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-zkwhb" podStartSLOduration=3.237570514 podStartE2EDuration="4.708642779s" podCreationTimestamp="2026-06-02 01:25:22 +0000 UTC" firstStartedPulling="2026-06-02 01:25:22.831178497 +0000 UTC m=+150.526100779" lastFinishedPulling="2026-06-02 01:25:24.302250763 +0000 UTC m=+151.997173044" observedRunningTime="2026-06-02 01:25:24.498714099 +0000 UTC m=+152.193636404" watchObservedRunningTime="2026-06-02 01:25:26.708642779 +0000 UTC m=+154.403565081" Jun 02 01:25:26.709249 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.709230 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-8xk8r"] Jun 02 01:25:26.711780 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.711763 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.714777 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.714754 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:25:26.715173 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.715151 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 01:25:26.715335 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.715313 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qq9f6\"" Jun 02 01:25:26.724904 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.724881 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-8xk8r"] Jun 02 01:25:26.729780 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.729763 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dtbtr"] Jun 02 01:25:26.731944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.731923 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.734691 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.734202 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:25:26.734691 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.734494 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:25:26.734691 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.734552 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n7ndj\"" Jun 02 01:25:26.734826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.734775 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:25:26.888208 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888178 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-wtmp\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888216 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dc42d67-ab2c-445a-b575-072e97f36bb4-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888245 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggrkx\" (UniqueName: \"kubernetes.io/projected/9dc42d67-ab2c-445a-b575-072e97f36bb4-kube-api-access-ggrkx\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888313 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-textfile\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888334 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-sys\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888395 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888456 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888490 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-tls\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888518 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpnss\" (UniqueName: \"kubernetes.io/projected/5ef311fe-5c0c-4702-b86b-bec07f9c701b-kube-api-access-wpnss\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888590 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-root\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888638 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dc42d67-ab2c-445a-b575-072e97f36bb4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.888666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888663 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9dc42d67-ab2c-445a-b575-072e97f36bb4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.889076 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.888683 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef311fe-5c0c-4702-b86b-bec07f9c701b-metrics-client-ca\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989147 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989047 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dc42d67-ab2c-445a-b575-072e97f36bb4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.989147 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989086 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9dc42d67-ab2c-445a-b575-072e97f36bb4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.989147 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989115 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef311fe-5c0c-4702-b86b-bec07f9c701b-metrics-client-ca\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989162 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-wtmp\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989194 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dc42d67-ab2c-445a-b575-072e97f36bb4-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989232 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggrkx\" (UniqueName: \"kubernetes.io/projected/9dc42d67-ab2c-445a-b575-072e97f36bb4-kube-api-access-ggrkx\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989269 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-textfile\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989292 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-sys\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989318 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989383 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989393 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-wtmp\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989817 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989409 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-tls\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989817 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989477 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpnss\" (UniqueName: \"kubernetes.io/projected/5ef311fe-5c0c-4702-b86b-bec07f9c701b-kube-api-access-wpnss\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989817 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989567 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-root\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989817 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989683 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-root\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.989817 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989809 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ef311fe-5c0c-4702-b86b-bec07f9c701b-metrics-client-ca\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.990046 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.990027 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ef311fe-5c0c-4702-b86b-bec07f9c701b-sys\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.990385 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.989970 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-textfile\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.990385 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.990253 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9dc42d67-ab2c-445a-b575-072e97f36bb4-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.990920 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.990896 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.992427 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.992403 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-tls\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.992558 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.992425 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ef311fe-5c0c-4702-b86b-bec07f9c701b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:26.992558 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.992456 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9dc42d67-ab2c-445a-b575-072e97f36bb4-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:26.993305 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:26.993286 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9dc42d67-ab2c-445a-b575-072e97f36bb4-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:27.001342 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.001299 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpnss\" (UniqueName: \"kubernetes.io/projected/5ef311fe-5c0c-4702-b86b-bec07f9c701b-kube-api-access-wpnss\") pod \"node-exporter-dtbtr\" (UID: \"5ef311fe-5c0c-4702-b86b-bec07f9c701b\") " pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:27.001865 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.001846 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggrkx\" (UniqueName: \"kubernetes.io/projected/9dc42d67-ab2c-445a-b575-072e97f36bb4-kube-api-access-ggrkx\") pod \"openshift-state-metrics-85658796db-8xk8r\" (UID: \"9dc42d67-ab2c-445a-b575-072e97f36bb4\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:27.022408 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.022384 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" Jun 02 01:25:27.042686 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.042663 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dtbtr" Jun 02 01:25:27.052485 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:27.052454 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef311fe_5c0c_4702_b86b_bec07f9c701b.slice/crio-e9e995af7b9f45364cf092c1d046d4c08a5e427be2795c7a4cd9535fccd66460 WatchSource:0}: Error finding container e9e995af7b9f45364cf092c1d046d4c08a5e427be2795c7a4cd9535fccd66460: Status 404 returned error can't find the container with id e9e995af7b9f45364cf092c1d046d4c08a5e427be2795c7a4cd9535fccd66460 Jun 02 01:25:27.165358 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.165286 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-8xk8r"] Jun 02 01:25:27.167813 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:27.167788 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc42d67_ab2c_445a_b575_072e97f36bb4.slice/crio-67292c1770c7c5999d5a422297687cee204505c2c0ab288cd60fd90cebbbe2c2 WatchSource:0}: Error finding container 67292c1770c7c5999d5a422297687cee204505c2c0ab288cd60fd90cebbbe2c2: Status 404 returned error can't find the container with id 67292c1770c7c5999d5a422297687cee204505c2c0ab288cd60fd90cebbbe2c2 Jun 02 01:25:27.491487 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.491404 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" event={"ID":"9dc42d67-ab2c-445a-b575-072e97f36bb4","Type":"ContainerStarted","Data":"f0a04ae52cd9f80b30422195fdd1bba7ffa061d9ed501d230521aead07850c57"} Jun 02 01:25:27.491487 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.491445 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" event={"ID":"9dc42d67-ab2c-445a-b575-072e97f36bb4","Type":"ContainerStarted","Data":"1346e44669aa1d84330b3663050bd90d60f4da3c9e3d2a78d8498b75fb31533f"} Jun 02 01:25:27.491487 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.491457 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" event={"ID":"9dc42d67-ab2c-445a-b575-072e97f36bb4","Type":"ContainerStarted","Data":"67292c1770c7c5999d5a422297687cee204505c2c0ab288cd60fd90cebbbe2c2"} Jun 02 01:25:27.492439 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.492413 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtbtr" event={"ID":"5ef311fe-5c0c-4702-b86b-bec07f9c701b","Type":"ContainerStarted","Data":"e9e995af7b9f45364cf092c1d046d4c08a5e427be2795c7a4cd9535fccd66460"} Jun 02 01:25:27.796470 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.796391 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:25:27.799772 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.799735 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.802468 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802442 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 02 01:25:27.802624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802472 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 02 01:25:27.802624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802497 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-gw92c\"" Jun 02 01:25:27.802624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802446 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 02 01:25:27.802798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802645 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 02 01:25:27.802798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802651 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 02 01:25:27.802798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802663 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 02 01:25:27.802798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802647 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 02 01:25:27.802798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802745 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 02 01:25:27.802798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.802789 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 02 01:25:27.812100 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.812071 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:25:27.898252 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898219 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898308 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898338 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898384 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898419 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898444 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898494 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-web-config\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898541 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-config-out\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898579 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898598 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898676 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.898715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898716 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gn4z\" (UniqueName: \"kubernetes.io/projected/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-kube-api-access-6gn4z\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.899106 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.898759 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999353 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999400 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999450 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999487 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999514 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999567 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-web-config\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999602 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-config-out\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999646 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:27.999671 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999671 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.000017 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999715 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.000017 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999756 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gn4z\" (UniqueName: \"kubernetes.io/projected/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-kube-api-access-6gn4z\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.000017 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999792 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.000017 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:27.999849 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.000846 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.000709 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.001600 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.001106 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.002398 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.002357 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.003245 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.003220 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-web-config\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.003924 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.003899 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-config-out\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.004061 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.003944 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.005335 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.004668 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-config-volume\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.005335 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.004912 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.005335 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.005300 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.006641 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.005971 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.006808 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.006785 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.007311 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.007269 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.008623 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.008602 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gn4z\" (UniqueName: \"kubernetes.io/projected/c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f-kube-api-access-6gn4z\") pod \"alertmanager-main-0\" (UID: \"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.111617 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.111514 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 02 01:25:28.356828 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.356803 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 02 01:25:28.455557 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:28.455509 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bd2dec_8fd0_48b1_90f1_cfcdeaf6555f.slice/crio-7bc31a86c26c143f9d0ad99da81a061a51988225d1cb1a01cbaa2a732812b74a WatchSource:0}: Error finding container 7bc31a86c26c143f9d0ad99da81a061a51988225d1cb1a01cbaa2a732812b74a: Status 404 returned error can't find the container with id 7bc31a86c26c143f9d0ad99da81a061a51988225d1cb1a01cbaa2a732812b74a Jun 02 01:25:28.499765 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.499736 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerStarted","Data":"7bc31a86c26c143f9d0ad99da81a061a51988225d1cb1a01cbaa2a732812b74a"} Jun 02 01:25:28.814162 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.814090 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:28.814162 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.814138 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:28.815322 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.815299 2609 patch_prober.go:28] interesting pod/console-6bfcf56b68-j4kv8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" start-of-body= Jun 02 01:25:28.815416 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:28.815348 2609 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6bfcf56b68-j4kv8" podUID="bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" containerName="console" probeResult="failure" output="Get \"https://10.134.0.18:8443/health\": dial tcp 10.134.0.18:8443: connect: connection refused" Jun 02 01:25:29.505177 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:29.505143 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" event={"ID":"9dc42d67-ab2c-445a-b575-072e97f36bb4","Type":"ContainerStarted","Data":"ca1605f09c7af40266f0b7bf97b064c6fd5c462bd8bd87a31850fd25cbda5bad"} Jun 02 01:25:29.506889 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:29.506861 2609 generic.go:358] "Generic (PLEG): container finished" podID="5ef311fe-5c0c-4702-b86b-bec07f9c701b" containerID="511b820bb669f936b6ca957474a82bfad2bae5c2d20527831717df2b818271d3" exitCode=0 Jun 02 01:25:29.507017 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:29.506900 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtbtr" event={"ID":"5ef311fe-5c0c-4702-b86b-bec07f9c701b","Type":"ContainerDied","Data":"511b820bb669f936b6ca957474a82bfad2bae5c2d20527831717df2b818271d3"} Jun 02 01:25:29.524427 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:29.524385 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-8xk8r" podStartSLOduration=2.358325895 podStartE2EDuration="3.524371667s" podCreationTimestamp="2026-06-02 01:25:26 +0000 UTC" firstStartedPulling="2026-06-02 01:25:27.312607029 +0000 UTC m=+155.007529312" lastFinishedPulling="2026-06-02 01:25:28.478652804 +0000 UTC m=+156.173575084" observedRunningTime="2026-06-02 01:25:29.523315234 +0000 UTC m=+157.218237537" watchObservedRunningTime="2026-06-02 01:25:29.524371667 +0000 UTC m=+157.219293971" Jun 02 01:25:29.674211 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:25:29.674156 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vz56r" podUID="c2eeaf9f-12dd-4ed2-925b-bc327f84fb54" Jun 02 01:25:29.680949 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:25:29.680921 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-r8gwk" podUID="60bd9749-f749-411f-bd85-6c73d2dfe4ed" Jun 02 01:25:30.511148 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:30.511111 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtbtr" event={"ID":"5ef311fe-5c0c-4702-b86b-bec07f9c701b","Type":"ContainerStarted","Data":"58836600e5d552d027f43319b346f57c8419cf69663462ae0905f98b89b8d229"} Jun 02 01:25:30.511570 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:30.511170 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dtbtr" event={"ID":"5ef311fe-5c0c-4702-b86b-bec07f9c701b","Type":"ContainerStarted","Data":"6902629b54e0b87140840a652d02cf13ac454fc88fa9f5f9edc8e728d60ef20b"} Jun 02 01:25:30.512365 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:30.512341 2609 generic.go:358] "Generic (PLEG): container finished" podID="c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f" containerID="0663b01351f41979762848ba31ea74edcbf495f9e315eb18d155087433c308a5" exitCode=0 Jun 02 01:25:30.512480 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:30.512458 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerDied","Data":"0663b01351f41979762848ba31ea74edcbf495f9e315eb18d155087433c308a5"} Jun 02 01:25:30.512559 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:30.512547 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:25:30.512818 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:30.512803 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vz56r" Jun 02 01:25:30.531227 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:30.531189 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dtbtr" podStartSLOduration=3.125361417 podStartE2EDuration="4.5311776s" podCreationTimestamp="2026-06-02 01:25:26 +0000 UTC" firstStartedPulling="2026-06-02 01:25:27.054246737 +0000 UTC m=+154.749169020" lastFinishedPulling="2026-06-02 01:25:28.460062906 +0000 UTC m=+156.154985203" observedRunningTime="2026-06-02 01:25:30.530475816 +0000 UTC m=+158.225398129" watchObservedRunningTime="2026-06-02 01:25:30.5311776 +0000 UTC m=+158.226099901" Jun 02 01:25:31.511035 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.511005 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-876dc74df-7226m"] Jun 02 01:25:31.540000 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.539969 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b8479856-2cjxl"] Jun 02 01:25:31.542569 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.542512 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.572447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.572423 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8479856-2cjxl"] Jun 02 01:25:31.631594 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.631551 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-oauth-serving-cert\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.631739 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.631688 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-oauth-config\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.631739 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.631727 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-config\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.631861 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.631769 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-trusted-ca-bundle\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.631861 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.631823 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-service-ca\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.631861 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.631854 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wv6\" (UniqueName: \"kubernetes.io/projected/8a1cf984-1640-44c1-8c57-83e6880ecee4-kube-api-access-b2wv6\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.632111 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.631889 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-serving-cert\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.732810 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.732782 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-oauth-serving-cert\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.732933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.732836 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-oauth-config\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.732933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.732855 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-config\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.732933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.732879 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-trusted-ca-bundle\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.732933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.732907 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-service-ca\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.732933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.732926 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wv6\" (UniqueName: \"kubernetes.io/projected/8a1cf984-1640-44c1-8c57-83e6880ecee4-kube-api-access-b2wv6\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.733174 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.732956 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-serving-cert\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.733663 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.733567 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-oauth-serving-cert\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.733663 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.733691 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-config\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.733918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.733746 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-service-ca\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.733918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.733880 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-trusted-ca-bundle\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.735416 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.735396 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-serving-cert\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.735517 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.735414 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-oauth-config\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.742571 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.742551 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wv6\" (UniqueName: \"kubernetes.io/projected/8a1cf984-1640-44c1-8c57-83e6880ecee4-kube-api-access-b2wv6\") pod \"console-5b8479856-2cjxl\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:31.854220 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:31.854140 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:32.268605 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.265422 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b8479856-2cjxl"] Jun 02 01:25:32.520622 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.520563 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8479856-2cjxl" event={"ID":"8a1cf984-1640-44c1-8c57-83e6880ecee4","Type":"ContainerStarted","Data":"c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f"} Jun 02 01:25:32.520737 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.520634 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8479856-2cjxl" event={"ID":"8a1cf984-1640-44c1-8c57-83e6880ecee4","Type":"ContainerStarted","Data":"8f29742f2d42f2c9364213e8bd05fc411802e4ae7943b6ab2bdf427caac16a76"} Jun 02 01:25:32.524011 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.523985 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerStarted","Data":"61bbbc9b1f4c494ff95e0c463b5f5e3942650f9116962085cf351a7900c23a40"} Jun 02 01:25:32.524107 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.524019 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerStarted","Data":"a918055e17dd780ae683acacc6afbe3db61ca445145be0f3fdb941a253dd0a6a"} Jun 02 01:25:32.524107 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.524033 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerStarted","Data":"f5fdf4956a72ac4298de7764a0f076fe4fea9ca67411df2cfce5e852a1518713"} Jun 02 01:25:32.524107 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.524047 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerStarted","Data":"8c1a15c268f4cb0c398c4ba7944989c7b0c716f3f6357d0e93de2796e3d07e81"} Jun 02 01:25:32.524107 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.524059 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerStarted","Data":"7da80e4d0c6ddb16588c5e45de7170ae85bcfb5fc499ce70ffe17181bdffc4a4"} Jun 02 01:25:32.537736 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:32.537694 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b8479856-2cjxl" podStartSLOduration=1.537680956 podStartE2EDuration="1.537680956s" podCreationTimestamp="2026-06-02 01:25:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:25:32.535983466 +0000 UTC m=+160.230905770" watchObservedRunningTime="2026-06-02 01:25:32.537680956 +0000 UTC m=+160.232603258" Jun 02 01:25:33.529438 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:33.529407 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f","Type":"ContainerStarted","Data":"7509175587f0e1fdccd30eeb0dc857c8354175f0407ca1ebdc463a60d935c49a"} Jun 02 01:25:33.555446 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:33.555403 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.5598572069999999 podStartE2EDuration="6.555389409s" podCreationTimestamp="2026-06-02 01:25:27 +0000 UTC" firstStartedPulling="2026-06-02 01:25:28.457606702 +0000 UTC m=+156.152528995" lastFinishedPulling="2026-06-02 01:25:33.453138903 +0000 UTC m=+161.148061197" observedRunningTime="2026-06-02 01:25:33.553600455 +0000 UTC m=+161.248522761" watchObservedRunningTime="2026-06-02 01:25:33.555389409 +0000 UTC m=+161.250311729" Jun 02 01:25:34.668049 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.668009 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:25:34.668500 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.668073 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:25:34.670425 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.670403 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2eeaf9f-12dd-4ed2-925b-bc327f84fb54-metrics-tls\") pod \"dns-default-vz56r\" (UID: \"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54\") " pod="openshift-dns/dns-default-vz56r" Jun 02 01:25:34.670544 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.670452 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60bd9749-f749-411f-bd85-6c73d2dfe4ed-cert\") pod \"ingress-canary-r8gwk\" (UID: \"60bd9749-f749-411f-bd85-6c73d2dfe4ed\") " pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:25:34.715562 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.715538 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xz25b\"" Jun 02 01:25:34.716186 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.716174 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8tqnd\"" Jun 02 01:25:34.724016 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.723996 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r8gwk" Jun 02 01:25:34.724105 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.724092 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vz56r" Jun 02 01:25:34.855348 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.855316 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r8gwk"] Jun 02 01:25:34.858376 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:34.858351 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bd9749_f749_411f_bd85_6c73d2dfe4ed.slice/crio-f52c9415da62a07cf1c73968cdfcfc70b1daa10a41e6358d759d89061afb35a2 WatchSource:0}: Error finding container f52c9415da62a07cf1c73968cdfcfc70b1daa10a41e6358d759d89061afb35a2: Status 404 returned error can't find the container with id f52c9415da62a07cf1c73968cdfcfc70b1daa10a41e6358d759d89061afb35a2 Jun 02 01:25:34.875071 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:34.875041 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vz56r"] Jun 02 01:25:34.877357 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:25:34.877337 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2eeaf9f_12dd_4ed2_925b_bc327f84fb54.slice/crio-d695451130fcb79bdf1de53b7ce5f948c01964c154e75e346a19401e6db7dc48 WatchSource:0}: Error finding container d695451130fcb79bdf1de53b7ce5f948c01964c154e75e346a19401e6db7dc48: Status 404 returned error can't find the container with id d695451130fcb79bdf1de53b7ce5f948c01964c154e75e346a19401e6db7dc48 Jun 02 01:25:35.540164 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:35.540102 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vz56r" event={"ID":"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54","Type":"ContainerStarted","Data":"d695451130fcb79bdf1de53b7ce5f948c01964c154e75e346a19401e6db7dc48"} Jun 02 01:25:35.541412 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:35.541382 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8gwk" event={"ID":"60bd9749-f749-411f-bd85-6c73d2dfe4ed","Type":"ContainerStarted","Data":"f52c9415da62a07cf1c73968cdfcfc70b1daa10a41e6358d759d89061afb35a2"} Jun 02 01:25:37.549459 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:37.549415 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vz56r" event={"ID":"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54","Type":"ContainerStarted","Data":"3238fc13bfafe913a5e3272bbb9c59e5b6976c82f38117a967bb53d5dee054bc"} Jun 02 01:25:37.549459 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:37.549452 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vz56r" event={"ID":"c2eeaf9f-12dd-4ed2-925b-bc327f84fb54","Type":"ContainerStarted","Data":"17089b760f9ac67f16a70fd00f50440672fec9a2d645981ae35ccf25e35f5cc8"} Jun 02 01:25:37.549986 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:37.549552 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vz56r" Jun 02 01:25:37.550793 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:37.550770 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r8gwk" event={"ID":"60bd9749-f749-411f-bd85-6c73d2dfe4ed","Type":"ContainerStarted","Data":"d67cceac949c2ea6d1812d5d2e81dd33beab7884a4968e6b5a2c0141aade27d1"} Jun 02 01:25:37.566659 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:37.566596 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-vz56r" podStartSLOduration=129.587443992 podStartE2EDuration="2m11.56658412s" podCreationTimestamp="2026-06-02 01:23:26 +0000 UTC" firstStartedPulling="2026-06-02 01:25:34.879160093 +0000 UTC m=+162.574082374" lastFinishedPulling="2026-06-02 01:25:36.858300222 +0000 UTC m=+164.553222502" observedRunningTime="2026-06-02 01:25:37.565256452 +0000 UTC m=+165.260178754" watchObservedRunningTime="2026-06-02 01:25:37.56658412 +0000 UTC m=+165.261506456" Jun 02 01:25:37.579680 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:37.579641 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r8gwk" podStartSLOduration=129.57807976 podStartE2EDuration="2m11.579630717s" podCreationTimestamp="2026-06-02 01:23:26 +0000 UTC" firstStartedPulling="2026-06-02 01:25:34.860325991 +0000 UTC m=+162.555248274" lastFinishedPulling="2026-06-02 01:25:36.861876941 +0000 UTC m=+164.556799231" observedRunningTime="2026-06-02 01:25:37.578840028 +0000 UTC m=+165.273762329" watchObservedRunningTime="2026-06-02 01:25:37.579630717 +0000 UTC m=+165.274553050" Jun 02 01:25:38.818285 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:38.818259 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:38.822137 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:38.822113 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:25:41.854332 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:41.854295 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:41.854790 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:41.854343 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:41.858821 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:41.858795 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:42.571253 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:42.571215 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:25:42.614356 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:42.614317 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfcf56b68-j4kv8"] Jun 02 01:25:47.555805 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:47.555778 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vz56r" Jun 02 01:25:56.539878 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.539833 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-876dc74df-7226m" podUID="28a01ce7-4f3e-4e93-8241-989c52da77b0" containerName="console" containerID="cri-o://f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb" gracePeriod=15 Jun 02 01:25:56.779298 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.779267 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-876dc74df-7226m_28a01ce7-4f3e-4e93-8241-989c52da77b0/console/0.log" Jun 02 01:25:56.779402 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.779348 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:56.853839 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.853768 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-oauth-config\") pod \"28a01ce7-4f3e-4e93-8241-989c52da77b0\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " Jun 02 01:25:56.853839 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.853830 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-service-ca\") pod \"28a01ce7-4f3e-4e93-8241-989c52da77b0\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " Jun 02 01:25:56.853996 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.853857 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-config\") pod \"28a01ce7-4f3e-4e93-8241-989c52da77b0\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " Jun 02 01:25:56.853996 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.853913 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fprmw\" (UniqueName: \"kubernetes.io/projected/28a01ce7-4f3e-4e93-8241-989c52da77b0-kube-api-access-fprmw\") pod \"28a01ce7-4f3e-4e93-8241-989c52da77b0\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " Jun 02 01:25:56.853996 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.853949 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-oauth-serving-cert\") pod \"28a01ce7-4f3e-4e93-8241-989c52da77b0\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " Jun 02 01:25:56.854136 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.854009 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-serving-cert\") pod \"28a01ce7-4f3e-4e93-8241-989c52da77b0\" (UID: \"28a01ce7-4f3e-4e93-8241-989c52da77b0\") " Jun 02 01:25:56.854313 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.854282 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "28a01ce7-4f3e-4e93-8241-989c52da77b0" (UID: "28a01ce7-4f3e-4e93-8241-989c52da77b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:25:56.854441 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.854286 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-config" (OuterVolumeSpecName: "console-config") pod "28a01ce7-4f3e-4e93-8241-989c52da77b0" (UID: "28a01ce7-4f3e-4e93-8241-989c52da77b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:25:56.854441 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.854376 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "28a01ce7-4f3e-4e93-8241-989c52da77b0" (UID: "28a01ce7-4f3e-4e93-8241-989c52da77b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:25:56.856262 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.856236 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "28a01ce7-4f3e-4e93-8241-989c52da77b0" (UID: "28a01ce7-4f3e-4e93-8241-989c52da77b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:25:56.856351 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.856293 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "28a01ce7-4f3e-4e93-8241-989c52da77b0" (UID: "28a01ce7-4f3e-4e93-8241-989c52da77b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:25:56.856351 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.856332 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28a01ce7-4f3e-4e93-8241-989c52da77b0-kube-api-access-fprmw" (OuterVolumeSpecName: "kube-api-access-fprmw") pod "28a01ce7-4f3e-4e93-8241-989c52da77b0" (UID: "28a01ce7-4f3e-4e93-8241-989c52da77b0"). InnerVolumeSpecName "kube-api-access-fprmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:25:56.954951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.954930 2609 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:25:56.954951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.954952 2609 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-oauth-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:25:56.955082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.954962 2609 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-service-ca\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:25:56.955082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.954971 2609 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-console-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:25:56.955082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.954980 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fprmw\" (UniqueName: \"kubernetes.io/projected/28a01ce7-4f3e-4e93-8241-989c52da77b0-kube-api-access-fprmw\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:25:56.955082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:56.954989 2609 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/28a01ce7-4f3e-4e93-8241-989c52da77b0-oauth-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:25:57.609535 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.609494 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-876dc74df-7226m_28a01ce7-4f3e-4e93-8241-989c52da77b0/console/0.log" Jun 02 01:25:57.610123 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.609549 2609 generic.go:358] "Generic (PLEG): container finished" podID="28a01ce7-4f3e-4e93-8241-989c52da77b0" containerID="f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb" exitCode=2 Jun 02 01:25:57.610123 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.609596 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc74df-7226m" event={"ID":"28a01ce7-4f3e-4e93-8241-989c52da77b0","Type":"ContainerDied","Data":"f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb"} Jun 02 01:25:57.610123 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.609622 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-876dc74df-7226m" event={"ID":"28a01ce7-4f3e-4e93-8241-989c52da77b0","Type":"ContainerDied","Data":"73ce291cabe680fdcbcf2fd1a8f7c50d0682ba143ab221b2b228b271791c5bd8"} Jun 02 01:25:57.610123 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.609629 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-876dc74df-7226m" Jun 02 01:25:57.610123 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.609638 2609 scope.go:117] "RemoveContainer" containerID="f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb" Jun 02 01:25:57.624949 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.624927 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-876dc74df-7226m"] Jun 02 01:25:57.628386 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.628364 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-876dc74df-7226m"] Jun 02 01:25:57.658559 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.658539 2609 scope.go:117] "RemoveContainer" containerID="f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb" Jun 02 01:25:57.658855 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:25:57.658824 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb\": container with ID starting with f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb not found: ID does not exist" containerID="f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb" Jun 02 01:25:57.658952 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:57.658864 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb"} err="failed to get container status \"f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb\": rpc error: code = NotFound desc = could not find container \"f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb\": container with ID starting with f27868ebd53488a86d04d5433f8b0874a777a7ab13e09128bdd259db5ab41ceb not found: ID does not exist" Jun 02 01:25:58.613714 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:58.613680 2609 generic.go:358] "Generic (PLEG): container finished" podID="370bb775-0ebd-495e-b42e-d92a9c89c419" containerID="9913376c8ce4f8163416099430284239bcf69c31c4798489f08442fe55ca30e2" exitCode=0 Jun 02 01:25:58.614158 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:58.613753 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-96x9s" event={"ID":"370bb775-0ebd-495e-b42e-d92a9c89c419","Type":"ContainerDied","Data":"9913376c8ce4f8163416099430284239bcf69c31c4798489f08442fe55ca30e2"} Jun 02 01:25:58.614158 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:58.614122 2609 scope.go:117] "RemoveContainer" containerID="9913376c8ce4f8163416099430284239bcf69c31c4798489f08442fe55ca30e2" Jun 02 01:25:58.936149 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:58.936119 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28a01ce7-4f3e-4e93-8241-989c52da77b0" path="/var/lib/kubelet/pods/28a01ce7-4f3e-4e93-8241-989c52da77b0/volumes" Jun 02 01:25:59.618996 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:25:59.618966 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-96x9s" event={"ID":"370bb775-0ebd-495e-b42e-d92a9c89c419","Type":"ContainerStarted","Data":"acb7c842cd178cf26e895cb86a507ca027465785b65d043cf3ab369b67355c34"} Jun 02 01:26:00.094771 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:00.094743 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/init-config-reloader/0.log" Jun 02 01:26:00.297069 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:00.297032 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/alertmanager/0.log" Jun 02 01:26:00.494418 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:00.494388 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/config-reloader/0.log" Jun 02 01:26:00.694926 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:00.694891 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/kube-rbac-proxy-web/0.log" Jun 02 01:26:00.894738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:00.894659 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/kube-rbac-proxy/0.log" Jun 02 01:26:01.094912 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:01.094886 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/kube-rbac-proxy-metric/0.log" Jun 02 01:26:01.294193 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:01.294167 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/prom-label-proxy/0.log" Jun 02 01:26:02.694035 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:02.694009 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtbtr_5ef311fe-5c0c-4702-b86b-bec07f9c701b/init-textfile/0.log" Jun 02 01:26:02.895600 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:02.895510 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtbtr_5ef311fe-5c0c-4702-b86b-bec07f9c701b/node-exporter/0.log" Jun 02 01:26:03.094081 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:03.094008 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtbtr_5ef311fe-5c0c-4702-b86b-bec07f9c701b/kube-rbac-proxy/0.log" Jun 02 01:26:04.494516 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:04.494472 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-8xk8r_9dc42d67-ab2c-445a-b575-072e97f36bb4/kube-rbac-proxy-main/0.log" Jun 02 01:26:04.694412 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:04.694386 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-8xk8r_9dc42d67-ab2c-445a-b575-072e97f36bb4/kube-rbac-proxy-self/0.log" Jun 02 01:26:04.893917 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:04.893839 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-8xk8r_9dc42d67-ab2c-445a-b575-072e97f36bb4/openshift-state-metrics/0.log" Jun 02 01:26:06.496144 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:06.496116 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-zkwhb_f17b27c0-9e47-439a-94e0-307d46be6ca1/prometheus-operator/0.log" Jun 02 01:26:06.694626 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:06.694598 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-zkwhb_f17b27c0-9e47-439a-94e0-307d46be6ca1/kube-rbac-proxy/0.log" Jun 02 01:26:06.894897 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:06.894818 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-zrvzb_001edd65-ef3a-4c3b-bb94-61b4bc978914/prometheus-operator-admission-webhook/0.log" Jun 02 01:26:07.634480 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:07.634443 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6bfcf56b68-j4kv8" podUID="bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" containerName="console" containerID="cri-o://5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b" gracePeriod=15 Jun 02 01:26:07.641719 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:07.641695 2609 generic.go:358] "Generic (PLEG): container finished" podID="3cf38036-924d-44f6-aac1-a2a83b04d5c5" containerID="8b743f47a48b97990a33a02b3f9eb5a74c4bfb40c66fc29558e5d7e4f6ad81b2" exitCode=0 Jun 02 01:26:07.641820 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:07.641765 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" event={"ID":"3cf38036-924d-44f6-aac1-a2a83b04d5c5","Type":"ContainerDied","Data":"8b743f47a48b97990a33a02b3f9eb5a74c4bfb40c66fc29558e5d7e4f6ad81b2"} Jun 02 01:26:07.642079 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:07.642065 2609 scope.go:117] "RemoveContainer" containerID="8b743f47a48b97990a33a02b3f9eb5a74c4bfb40c66fc29558e5d7e4f6ad81b2" Jun 02 01:26:07.914920 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:07.914884 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bfcf56b68-j4kv8_bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf/console/0.log" Jun 02 01:26:07.915032 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:07.914960 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:26:08.040468 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040397 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-oauth-config\") pod \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " Jun 02 01:26:08.040468 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040434 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-config\") pod \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " Jun 02 01:26:08.040468 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040465 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-service-ca\") pod \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " Jun 02 01:26:08.040729 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040602 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-oauth-serving-cert\") pod \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " Jun 02 01:26:08.040729 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040665 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-trusted-ca-bundle\") pod \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " Jun 02 01:26:08.040729 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040693 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psqlm\" (UniqueName: \"kubernetes.io/projected/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-kube-api-access-psqlm\") pod \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " Jun 02 01:26:08.040942 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040745 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-serving-cert\") pod \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\" (UID: \"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf\") " Jun 02 01:26:08.040942 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040915 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-service-ca" (OuterVolumeSpecName: "service-ca") pod "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" (UID: "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:26:08.041043 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.040974 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-config" (OuterVolumeSpecName: "console-config") pod "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" (UID: "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:26:08.041043 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.041000 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" (UID: "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:26:08.041043 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.041019 2609 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-service-ca\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:26:08.041143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.041074 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" (UID: "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:26:08.042979 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.042955 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" (UID: "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:26:08.043074 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.042974 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" (UID: "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:26:08.043074 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.042974 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-kube-api-access-psqlm" (OuterVolumeSpecName: "kube-api-access-psqlm") pod "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" (UID: "bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf"). InnerVolumeSpecName "kube-api-access-psqlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:26:08.141952 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.141921 2609 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-trusted-ca-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:26:08.141952 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.141947 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psqlm\" (UniqueName: \"kubernetes.io/projected/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-kube-api-access-psqlm\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:26:08.141952 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.141957 2609 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:26:08.142125 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.141966 2609 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-oauth-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:26:08.142125 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.141975 2609 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-console-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:26:08.142125 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.141983 2609 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf-oauth-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:26:08.494262 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.494229 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:26:08.648104 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.648080 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bfcf56b68-j4kv8_bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf/console/0.log" Jun 02 01:26:08.648499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.648126 2609 generic.go:358] "Generic (PLEG): container finished" podID="bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" containerID="5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b" exitCode=2 Jun 02 01:26:08.648499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.648188 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfcf56b68-j4kv8" Jun 02 01:26:08.648499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.648188 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfcf56b68-j4kv8" event={"ID":"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf","Type":"ContainerDied","Data":"5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b"} Jun 02 01:26:08.648499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.648238 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfcf56b68-j4kv8" event={"ID":"bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf","Type":"ContainerDied","Data":"9d7a4730024f24a35f50f85e83de6874769d36951f2f9b367ccf89ae8d74ff5b"} Jun 02 01:26:08.648499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.648262 2609 scope.go:117] "RemoveContainer" containerID="5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b" Jun 02 01:26:08.649985 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.649963 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-fzjwq" event={"ID":"3cf38036-924d-44f6-aac1-a2a83b04d5c5","Type":"ContainerStarted","Data":"308c7159be0f43bb8907f79e144d11f4eada2e51dee6af6bf95eafbb4834ad79"} Jun 02 01:26:08.656822 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.656793 2609 scope.go:117] "RemoveContainer" containerID="5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b" Jun 02 01:26:08.657034 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:26:08.657016 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b\": container with ID starting with 5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b not found: ID does not exist" containerID="5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b" Jun 02 01:26:08.657081 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.657041 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b"} err="failed to get container status \"5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b\": rpc error: code = NotFound desc = could not find container \"5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b\": container with ID starting with 5093101e0582c1dcf2188cc58806df11c3bfb4defbec679087863b47b13ff33b not found: ID does not exist" Jun 02 01:26:08.686752 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.682285 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfcf56b68-j4kv8"] Jun 02 01:26:08.687596 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.687571 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bfcf56b68-j4kv8"] Jun 02 01:26:08.695615 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.695596 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/2.log" Jun 02 01:26:08.894850 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.894774 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b8479856-2cjxl_8a1cf984-1640-44c1-8c57-83e6880ecee4/console/0.log" Jun 02 01:26:08.935952 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:08.935927 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" path="/var/lib/kubelet/pods/bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf/volumes" Jun 02 01:26:10.094035 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:10.094004 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8gwk_60bd9749-f749-411f-bd85-6c73d2dfe4ed/serve-healthcheck-canary/0.log" Jun 02 01:26:18.685103 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:18.685072 2609 generic.go:358] "Generic (PLEG): container finished" podID="81be2234-eadc-4bd8-bc01-0b21cdba80cc" containerID="958ac7e08cd44846e994b04248f16d3aa78599b32d14a4d03765febea0bc9e01" exitCode=0 Jun 02 01:26:18.685581 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:18.685153 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" event={"ID":"81be2234-eadc-4bd8-bc01-0b21cdba80cc","Type":"ContainerDied","Data":"958ac7e08cd44846e994b04248f16d3aa78599b32d14a4d03765febea0bc9e01"} Jun 02 01:26:18.685581 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:18.685501 2609 scope.go:117] "RemoveContainer" containerID="958ac7e08cd44846e994b04248f16d3aa78599b32d14a4d03765febea0bc9e01" Jun 02 01:26:19.689912 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:19.689881 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-df7v8" event={"ID":"81be2234-eadc-4bd8-bc01-0b21cdba80cc","Type":"ContainerStarted","Data":"eca20bd61e4755a43bd48bd8246047067821b20e0675130976a257b18a958ffb"} Jun 02 01:26:51.033816 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.033781 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f97cf7796-9khh5"] Jun 02 01:26:51.034829 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.034806 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28a01ce7-4f3e-4e93-8241-989c52da77b0" containerName="console" Jun 02 01:26:51.034967 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.034950 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="28a01ce7-4f3e-4e93-8241-989c52da77b0" containerName="console" Jun 02 01:26:51.035033 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.034977 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" containerName="console" Jun 02 01:26:51.035033 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.034985 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" containerName="console" Jun 02 01:26:51.035134 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.035070 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="28a01ce7-4f3e-4e93-8241-989c52da77b0" containerName="console" Jun 02 01:26:51.035134 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.035082 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="bb1b5b8f-093d-48bd-8ec0-ff2f999b8fbf" containerName="console" Jun 02 01:26:51.038325 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.038307 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.041226 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.040832 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 02 01:26:51.041226 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.041070 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 02 01:26:51.041384 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.041237 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 02 01:26:51.041946 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.041923 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 02 01:26:51.042139 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.042102 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 02 01:26:51.042207 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.042195 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mhtsg\"" Jun 02 01:26:51.045780 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.045748 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 02 01:26:51.047723 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.047150 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f97cf7796-9khh5"] Jun 02 01:26:51.151280 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151252 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.151280 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151289 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-metrics-client-ca\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.151507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151316 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-serving-certs-ca-bundle\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.151507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151364 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-telemeter-client-tls\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.151507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151384 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5vj\" (UniqueName: \"kubernetes.io/projected/420a26e0-508d-4bf3-9664-4bb92684d523-kube-api-access-4z5vj\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.151507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151405 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-secret-telemeter-client\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.151507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151422 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-federate-client-tls\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.151507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.151437 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251770 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251808 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-metrics-client-ca\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251834 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-serving-certs-ca-bundle\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251868 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-telemeter-client-tls\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251891 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5vj\" (UniqueName: \"kubernetes.io/projected/420a26e0-508d-4bf3-9664-4bb92684d523-kube-api-access-4z5vj\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251911 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-secret-telemeter-client\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251931 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-federate-client-tls\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.251965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.251954 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.252580 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.252553 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-metrics-client-ca\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.252878 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.252661 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-serving-certs-ca-bundle\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.252950 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.252834 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420a26e0-508d-4bf3-9664-4bb92684d523-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.254489 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.254469 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.254701 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.254680 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-federate-client-tls\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.254872 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.254854 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-telemeter-client-tls\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.254984 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.254964 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/420a26e0-508d-4bf3-9664-4bb92684d523-secret-telemeter-client\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.259957 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.259939 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5vj\" (UniqueName: \"kubernetes.io/projected/420a26e0-508d-4bf3-9664-4bb92684d523-kube-api-access-4z5vj\") pod \"telemeter-client-6f97cf7796-9khh5\" (UID: \"420a26e0-508d-4bf3-9664-4bb92684d523\") " pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.351110 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.351051 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" Jun 02 01:26:51.480872 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.480847 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f97cf7796-9khh5"] Jun 02 01:26:51.482857 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:26:51.482826 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420a26e0_508d_4bf3_9664_4bb92684d523.slice/crio-a0814bc4763a5f7fe1ee96f0770f37fe3de1e013155319c9117b24007be7d2a5 WatchSource:0}: Error finding container a0814bc4763a5f7fe1ee96f0770f37fe3de1e013155319c9117b24007be7d2a5: Status 404 returned error can't find the container with id a0814bc4763a5f7fe1ee96f0770f37fe3de1e013155319c9117b24007be7d2a5 Jun 02 01:26:51.781556 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:51.781515 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" event={"ID":"420a26e0-508d-4bf3-9664-4bb92684d523","Type":"ContainerStarted","Data":"a0814bc4763a5f7fe1ee96f0770f37fe3de1e013155319c9117b24007be7d2a5"} Jun 02 01:26:54.794297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:54.794260 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" event={"ID":"420a26e0-508d-4bf3-9664-4bb92684d523","Type":"ContainerStarted","Data":"f813b32fb3cb25874392c9552f184730a011897f9b9b2649aa2365bb1564c679"} Jun 02 01:26:54.794297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:54.794298 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" event={"ID":"420a26e0-508d-4bf3-9664-4bb92684d523","Type":"ContainerStarted","Data":"a8f985835cb694c6de6b269889725ce152c98c28ad35ae8ee19cd09c8b3383dc"} Jun 02 01:26:54.794297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:54.794308 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" event={"ID":"420a26e0-508d-4bf3-9664-4bb92684d523","Type":"ContainerStarted","Data":"66d36cf04a4a033d931b27d38efd6fb8adc7e4a289bdcc709b13899ed0328e35"} Jun 02 01:26:54.815302 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:54.815257 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f97cf7796-9khh5" podStartSLOduration=1.5234564659999998 podStartE2EDuration="3.815239687s" podCreationTimestamp="2026-06-02 01:26:51 +0000 UTC" firstStartedPulling="2026-06-02 01:26:51.484578031 +0000 UTC m=+239.179500314" lastFinishedPulling="2026-06-02 01:26:53.77636125 +0000 UTC m=+241.471283535" observedRunningTime="2026-06-02 01:26:54.813507605 +0000 UTC m=+242.508429908" watchObservedRunningTime="2026-06-02 01:26:54.815239687 +0000 UTC m=+242.510161988" Jun 02 01:26:55.487374 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.487337 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-678ddbcb94-5t7vf"] Jun 02 01:26:55.490821 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.490799 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.499039 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.499014 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678ddbcb94-5t7vf"] Jun 02 01:26:55.587627 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.587598 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-oauth-config\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.587627 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.587630 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-service-ca\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.587831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.587652 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-trusted-ca-bundle\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.587831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.587673 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-console-config\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.587831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.587754 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-serving-cert\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.587831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.587782 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-oauth-serving-cert\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.587831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.587819 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n9lj\" (UniqueName: \"kubernetes.io/projected/c988075b-cebe-4d19-81ae-65705bb99421-kube-api-access-2n9lj\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.688695 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.688665 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-serving-cert\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.688695 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.688695 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-oauth-serving-cert\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.688875 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.688726 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n9lj\" (UniqueName: \"kubernetes.io/projected/c988075b-cebe-4d19-81ae-65705bb99421-kube-api-access-2n9lj\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.688875 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.688750 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-oauth-config\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.688875 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.688773 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-service-ca\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.688875 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.688830 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-trusted-ca-bundle\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.689093 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.688866 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-console-config\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.689563 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.689539 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-service-ca\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.689563 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.689555 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-console-config\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.689730 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.689709 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-oauth-serving-cert\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.689963 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.689939 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-trusted-ca-bundle\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.691297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.691274 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-oauth-config\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.691389 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.691363 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-serving-cert\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.698267 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.698249 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n9lj\" (UniqueName: \"kubernetes.io/projected/c988075b-cebe-4d19-81ae-65705bb99421-kube-api-access-2n9lj\") pod \"console-678ddbcb94-5t7vf\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.801603 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.801541 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:26:55.930922 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:55.930900 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678ddbcb94-5t7vf"] Jun 02 01:26:55.933166 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:26:55.933135 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc988075b_cebe_4d19_81ae_65705bb99421.slice/crio-9359722013cfb0dba1b478dabea2deeb4e089f688ed391894727fffa485a111d WatchSource:0}: Error finding container 9359722013cfb0dba1b478dabea2deeb4e089f688ed391894727fffa485a111d: Status 404 returned error can't find the container with id 9359722013cfb0dba1b478dabea2deeb4e089f688ed391894727fffa485a111d Jun 02 01:26:56.801216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:56.801183 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678ddbcb94-5t7vf" event={"ID":"c988075b-cebe-4d19-81ae-65705bb99421","Type":"ContainerStarted","Data":"d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66"} Jun 02 01:26:56.801216 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:56.801218 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678ddbcb94-5t7vf" event={"ID":"c988075b-cebe-4d19-81ae-65705bb99421","Type":"ContainerStarted","Data":"9359722013cfb0dba1b478dabea2deeb4e089f688ed391894727fffa485a111d"} Jun 02 01:26:56.817785 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:26:56.817729 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-678ddbcb94-5t7vf" podStartSLOduration=1.8177149959999999 podStartE2EDuration="1.817714996s" podCreationTimestamp="2026-06-02 01:26:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:26:56.817114617 +0000 UTC m=+244.512036919" watchObservedRunningTime="2026-06-02 01:26:56.817714996 +0000 UTC m=+244.512637297" Jun 02 01:27:05.802361 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:05.802323 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:27:05.802361 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:05.802367 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:27:05.807267 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:05.807247 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:27:05.830205 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:05.830158 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:27:05.900850 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:05.900814 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8479856-2cjxl"] Jun 02 01:27:06.043670 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.043579 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b6d495958-h2vfd"] Jun 02 01:27:06.046851 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.046830 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.058787 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.058763 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6d495958-h2vfd"] Jun 02 01:27:06.174802 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.174774 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-service-ca\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.174959 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.174807 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-oauth-serving-cert\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.174959 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.174835 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-trusted-ca-bundle\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.174959 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.174889 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-serving-cert\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.174959 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.174925 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-config\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.175088 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.174977 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sl76\" (UniqueName: \"kubernetes.io/projected/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-kube-api-access-4sl76\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.175088 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.174996 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-oauth-config\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.276252 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.276214 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4sl76\" (UniqueName: \"kubernetes.io/projected/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-kube-api-access-4sl76\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.276252 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.276254 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-oauth-config\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.276469 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.276306 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-service-ca\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.276469 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.276331 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-oauth-serving-cert\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.276469 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.276373 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-trusted-ca-bundle\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.276469 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.276405 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-serving-cert\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.276469 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.276444 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-config\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.277070 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.277048 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-service-ca\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.277289 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.277271 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-trusted-ca-bundle\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.277340 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.277305 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-oauth-serving-cert\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.277398 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.277378 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-config\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.278926 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.278898 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-oauth-config\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.279092 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.279072 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-serving-cert\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.286650 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.286629 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sl76\" (UniqueName: \"kubernetes.io/projected/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-kube-api-access-4sl76\") pod \"console-5b6d495958-h2vfd\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.357218 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.357135 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:06.485004 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.484971 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6d495958-h2vfd"] Jun 02 01:27:06.488160 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:27:06.488123 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5cb5a3_5314_4be5_9fb4_3d3a68313b41.slice/crio-4bf91163964baac78bc94c5d1703b013277670057a10c7acf59cf96c3382c8c6 WatchSource:0}: Error finding container 4bf91163964baac78bc94c5d1703b013277670057a10c7acf59cf96c3382c8c6: Status 404 returned error can't find the container with id 4bf91163964baac78bc94c5d1703b013277670057a10c7acf59cf96c3382c8c6 Jun 02 01:27:06.830598 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.830553 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d495958-h2vfd" event={"ID":"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41","Type":"ContainerStarted","Data":"3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec"} Jun 02 01:27:06.830598 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.830598 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d495958-h2vfd" event={"ID":"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41","Type":"ContainerStarted","Data":"4bf91163964baac78bc94c5d1703b013277670057a10c7acf59cf96c3382c8c6"} Jun 02 01:27:06.848468 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:06.848418 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5b6d495958-h2vfd" podStartSLOduration=0.848403317 podStartE2EDuration="848.403317ms" podCreationTimestamp="2026-06-02 01:27:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:27:06.846618771 +0000 UTC m=+254.541541072" watchObservedRunningTime="2026-06-02 01:27:06.848403317 +0000 UTC m=+254.543325619" Jun 02 01:27:16.358001 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:16.357951 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:16.358001 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:16.358004 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:16.362822 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:16.362800 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:16.864112 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:16.864085 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:27:16.910585 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:16.910556 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678ddbcb94-5t7vf"] Jun 02 01:27:30.920841 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:30.920791 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5b8479856-2cjxl" podUID="8a1cf984-1640-44c1-8c57-83e6880ecee4" containerName="console" containerID="cri-o://c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f" gracePeriod=15 Jun 02 01:27:31.164713 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.164689 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b8479856-2cjxl_8a1cf984-1640-44c1-8c57-83e6880ecee4/console/0.log" Jun 02 01:27:31.164828 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.164752 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:27:31.178744 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.178723 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-oauth-config\") pod \"8a1cf984-1640-44c1-8c57-83e6880ecee4\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " Jun 02 01:27:31.178864 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.178766 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-oauth-serving-cert\") pod \"8a1cf984-1640-44c1-8c57-83e6880ecee4\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " Jun 02 01:27:31.178864 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.178789 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-service-ca\") pod \"8a1cf984-1640-44c1-8c57-83e6880ecee4\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " Jun 02 01:27:31.178864 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.178843 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-serving-cert\") pod \"8a1cf984-1640-44c1-8c57-83e6880ecee4\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " Jun 02 01:27:31.179016 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.178870 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2wv6\" (UniqueName: \"kubernetes.io/projected/8a1cf984-1640-44c1-8c57-83e6880ecee4-kube-api-access-b2wv6\") pod \"8a1cf984-1640-44c1-8c57-83e6880ecee4\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " Jun 02 01:27:31.179016 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.178911 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-config\") pod \"8a1cf984-1640-44c1-8c57-83e6880ecee4\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " Jun 02 01:27:31.179109 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.179017 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-trusted-ca-bundle\") pod \"8a1cf984-1640-44c1-8c57-83e6880ecee4\" (UID: \"8a1cf984-1640-44c1-8c57-83e6880ecee4\") " Jun 02 01:27:31.179214 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.179190 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a1cf984-1640-44c1-8c57-83e6880ecee4" (UID: "8a1cf984-1640-44c1-8c57-83e6880ecee4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:31.179289 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.179229 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a1cf984-1640-44c1-8c57-83e6880ecee4" (UID: "8a1cf984-1640-44c1-8c57-83e6880ecee4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:31.179359 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.179287 2609 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-oauth-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:31.179359 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.179296 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-config" (OuterVolumeSpecName: "console-config") pod "8a1cf984-1640-44c1-8c57-83e6880ecee4" (UID: "8a1cf984-1640-44c1-8c57-83e6880ecee4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:31.179495 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.179477 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a1cf984-1640-44c1-8c57-83e6880ecee4" (UID: "8a1cf984-1640-44c1-8c57-83e6880ecee4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:31.180995 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.180973 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a1cf984-1640-44c1-8c57-83e6880ecee4-kube-api-access-b2wv6" (OuterVolumeSpecName: "kube-api-access-b2wv6") pod "8a1cf984-1640-44c1-8c57-83e6880ecee4" (UID: "8a1cf984-1640-44c1-8c57-83e6880ecee4"). InnerVolumeSpecName "kube-api-access-b2wv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:27:31.181382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.181359 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a1cf984-1640-44c1-8c57-83e6880ecee4" (UID: "8a1cf984-1640-44c1-8c57-83e6880ecee4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:27:31.181499 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.181386 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a1cf984-1640-44c1-8c57-83e6880ecee4" (UID: "8a1cf984-1640-44c1-8c57-83e6880ecee4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:27:31.280051 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.280021 2609 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:31.280051 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.280051 2609 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-trusted-ca-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:31.280231 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.280061 2609 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-oauth-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:31.280231 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.280070 2609 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1cf984-1640-44c1-8c57-83e6880ecee4-service-ca\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:31.280231 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.280079 2609 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a1cf984-1640-44c1-8c57-83e6880ecee4-console-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:31.280231 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.280087 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2wv6\" (UniqueName: \"kubernetes.io/projected/8a1cf984-1640-44c1-8c57-83e6880ecee4-kube-api-access-b2wv6\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:31.906043 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.906013 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b8479856-2cjxl_8a1cf984-1640-44c1-8c57-83e6880ecee4/console/0.log" Jun 02 01:27:31.906195 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.906055 2609 generic.go:358] "Generic (PLEG): container finished" podID="8a1cf984-1640-44c1-8c57-83e6880ecee4" containerID="c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f" exitCode=2 Jun 02 01:27:31.906195 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.906092 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8479856-2cjxl" event={"ID":"8a1cf984-1640-44c1-8c57-83e6880ecee4","Type":"ContainerDied","Data":"c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f"} Jun 02 01:27:31.906195 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.906120 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b8479856-2cjxl" event={"ID":"8a1cf984-1640-44c1-8c57-83e6880ecee4","Type":"ContainerDied","Data":"8f29742f2d42f2c9364213e8bd05fc411802e4ae7943b6ab2bdf427caac16a76"} Jun 02 01:27:31.906195 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.906124 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b8479856-2cjxl" Jun 02 01:27:31.906195 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.906148 2609 scope.go:117] "RemoveContainer" containerID="c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f" Jun 02 01:27:31.917311 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.917185 2609 scope.go:117] "RemoveContainer" containerID="c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f" Jun 02 01:27:31.917569 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:27:31.917544 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f\": container with ID starting with c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f not found: ID does not exist" containerID="c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f" Jun 02 01:27:31.917657 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.917585 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f"} err="failed to get container status \"c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f\": rpc error: code = NotFound desc = could not find container \"c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f\": container with ID starting with c93168663890d621e5c777a73bfaaa8894643bb68824ee31fa02a799448f461f not found: ID does not exist" Jun 02 01:27:31.926587 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.926562 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b8479856-2cjxl"] Jun 02 01:27:31.929699 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:31.929681 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b8479856-2cjxl"] Jun 02 01:27:32.941048 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:32.941012 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1cf984-1640-44c1-8c57-83e6880ecee4" path="/var/lib/kubelet/pods/8a1cf984-1640-44c1-8c57-83e6880ecee4/volumes" Jun 02 01:27:41.931647 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:41.931579 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-678ddbcb94-5t7vf" podUID="c988075b-cebe-4d19-81ae-65705bb99421" containerName="console" containerID="cri-o://d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66" gracePeriod=15 Jun 02 01:27:42.176116 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.176086 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-678ddbcb94-5t7vf_c988075b-cebe-4d19-81ae-65705bb99421/console/0.log" Jun 02 01:27:42.176240 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.176149 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:27:42.256050 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.255957 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-oauth-config\") pod \"c988075b-cebe-4d19-81ae-65705bb99421\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " Jun 02 01:27:42.256050 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.255995 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-trusted-ca-bundle\") pod \"c988075b-cebe-4d19-81ae-65705bb99421\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " Jun 02 01:27:42.256265 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256133 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-console-config\") pod \"c988075b-cebe-4d19-81ae-65705bb99421\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " Jun 02 01:27:42.256265 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256183 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-service-ca\") pod \"c988075b-cebe-4d19-81ae-65705bb99421\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " Jun 02 01:27:42.256265 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256206 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n9lj\" (UniqueName: \"kubernetes.io/projected/c988075b-cebe-4d19-81ae-65705bb99421-kube-api-access-2n9lj\") pod \"c988075b-cebe-4d19-81ae-65705bb99421\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " Jun 02 01:27:42.256265 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256239 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-serving-cert\") pod \"c988075b-cebe-4d19-81ae-65705bb99421\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " Jun 02 01:27:42.256463 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256314 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-oauth-serving-cert\") pod \"c988075b-cebe-4d19-81ae-65705bb99421\" (UID: \"c988075b-cebe-4d19-81ae-65705bb99421\") " Jun 02 01:27:42.256547 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256494 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c988075b-cebe-4d19-81ae-65705bb99421" (UID: "c988075b-cebe-4d19-81ae-65705bb99421"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:42.256547 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256504 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-console-config" (OuterVolumeSpecName: "console-config") pod "c988075b-cebe-4d19-81ae-65705bb99421" (UID: "c988075b-cebe-4d19-81ae-65705bb99421"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:42.256663 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256516 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-service-ca" (OuterVolumeSpecName: "service-ca") pod "c988075b-cebe-4d19-81ae-65705bb99421" (UID: "c988075b-cebe-4d19-81ae-65705bb99421"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:42.256837 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.256816 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c988075b-cebe-4d19-81ae-65705bb99421" (UID: "c988075b-cebe-4d19-81ae-65705bb99421"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:27:42.258337 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.258310 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c988075b-cebe-4d19-81ae-65705bb99421" (UID: "c988075b-cebe-4d19-81ae-65705bb99421"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:27:42.258449 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.258398 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c988075b-cebe-4d19-81ae-65705bb99421" (UID: "c988075b-cebe-4d19-81ae-65705bb99421"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:27:42.258449 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.258408 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c988075b-cebe-4d19-81ae-65705bb99421-kube-api-access-2n9lj" (OuterVolumeSpecName: "kube-api-access-2n9lj") pod "c988075b-cebe-4d19-81ae-65705bb99421" (UID: "c988075b-cebe-4d19-81ae-65705bb99421"). InnerVolumeSpecName "kube-api-access-2n9lj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:27:42.357689 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.357655 2609 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-console-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:42.357689 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.357683 2609 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-service-ca\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:42.357689 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.357692 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n9lj\" (UniqueName: \"kubernetes.io/projected/c988075b-cebe-4d19-81ae-65705bb99421-kube-api-access-2n9lj\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:42.357918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.357704 2609 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:42.357918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.357713 2609 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-oauth-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:42.357918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.357721 2609 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c988075b-cebe-4d19-81ae-65705bb99421-console-oauth-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:42.357918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.357730 2609 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c988075b-cebe-4d19-81ae-65705bb99421-trusted-ca-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:27:42.937616 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.937592 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-678ddbcb94-5t7vf_c988075b-cebe-4d19-81ae-65705bb99421/console/0.log" Jun 02 01:27:42.938095 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.937631 2609 generic.go:358] "Generic (PLEG): container finished" podID="c988075b-cebe-4d19-81ae-65705bb99421" containerID="d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66" exitCode=2 Jun 02 01:27:42.938095 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.937709 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678ddbcb94-5t7vf" Jun 02 01:27:42.938095 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.937727 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678ddbcb94-5t7vf" event={"ID":"c988075b-cebe-4d19-81ae-65705bb99421","Type":"ContainerDied","Data":"d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66"} Jun 02 01:27:42.938095 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.937768 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678ddbcb94-5t7vf" event={"ID":"c988075b-cebe-4d19-81ae-65705bb99421","Type":"ContainerDied","Data":"9359722013cfb0dba1b478dabea2deeb4e089f688ed391894727fffa485a111d"} Jun 02 01:27:42.938095 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.937790 2609 scope.go:117] "RemoveContainer" containerID="d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66" Jun 02 01:27:42.946226 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.946099 2609 scope.go:117] "RemoveContainer" containerID="d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66" Jun 02 01:27:42.946363 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:27:42.946340 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66\": container with ID starting with d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66 not found: ID does not exist" containerID="d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66" Jun 02 01:27:42.946411 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.946374 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66"} err="failed to get container status \"d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66\": rpc error: code = NotFound desc = could not find container \"d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66\": container with ID starting with d517d751e19c312c3380a13188db7a928e724f9abac7ff13c9374daddc274b66 not found: ID does not exist" Jun 02 01:27:42.960060 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.960041 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678ddbcb94-5t7vf"] Jun 02 01:27:42.964326 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:42.964305 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-678ddbcb94-5t7vf"] Jun 02 01:27:44.935949 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:44.935914 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c988075b-cebe-4d19-81ae-65705bb99421" path="/var/lib/kubelet/pods/c988075b-cebe-4d19-81ae-65705bb99421/volumes" Jun 02 01:27:51.020030 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.020001 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5zh6l"] Jun 02 01:27:51.020450 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.020290 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c988075b-cebe-4d19-81ae-65705bb99421" containerName="console" Jun 02 01:27:51.020450 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.020300 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="c988075b-cebe-4d19-81ae-65705bb99421" containerName="console" Jun 02 01:27:51.020450 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.020311 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1cf984-1640-44c1-8c57-83e6880ecee4" containerName="console" Jun 02 01:27:51.020450 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.020317 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1cf984-1640-44c1-8c57-83e6880ecee4" containerName="console" Jun 02 01:27:51.020450 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.020367 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="c988075b-cebe-4d19-81ae-65705bb99421" containerName="console" Jun 02 01:27:51.020450 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.020376 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="8a1cf984-1640-44c1-8c57-83e6880ecee4" containerName="console" Jun 02 01:27:51.024710 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.024691 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.026927 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.026908 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:27:51.029667 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.029643 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zh6l"] Jun 02 01:27:51.118699 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.118673 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02122a14-5e0b-464b-a926-8b1315b02b0a-original-pull-secret\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.118816 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.118716 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02122a14-5e0b-464b-a926-8b1315b02b0a-dbus\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.118816 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.118802 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02122a14-5e0b-464b-a926-8b1315b02b0a-kubelet-config\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.219903 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.219875 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02122a14-5e0b-464b-a926-8b1315b02b0a-original-pull-secret\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.220017 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.219910 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02122a14-5e0b-464b-a926-8b1315b02b0a-dbus\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.220017 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.219948 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02122a14-5e0b-464b-a926-8b1315b02b0a-kubelet-config\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.220126 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.220018 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02122a14-5e0b-464b-a926-8b1315b02b0a-kubelet-config\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.220218 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.220148 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02122a14-5e0b-464b-a926-8b1315b02b0a-dbus\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.222006 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.221989 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02122a14-5e0b-464b-a926-8b1315b02b0a-original-pull-secret\") pod \"global-pull-secret-syncer-5zh6l\" (UID: \"02122a14-5e0b-464b-a926-8b1315b02b0a\") " pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.335172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.335115 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5zh6l" Jun 02 01:27:51.458973 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.458942 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5zh6l"] Jun 02 01:27:51.461411 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:27:51.461381 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02122a14_5e0b_464b_a926_8b1315b02b0a.slice/crio-edd905565a62815c634e4522f4fd916fb4c0fece83ec3deb2c6b45ab2e6c3677 WatchSource:0}: Error finding container edd905565a62815c634e4522f4fd916fb4c0fece83ec3deb2c6b45ab2e6c3677: Status 404 returned error can't find the container with id edd905565a62815c634e4522f4fd916fb4c0fece83ec3deb2c6b45ab2e6c3677 Jun 02 01:27:51.964774 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:51.964743 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zh6l" event={"ID":"02122a14-5e0b-464b-a926-8b1315b02b0a","Type":"ContainerStarted","Data":"edd905565a62815c634e4522f4fd916fb4c0fece83ec3deb2c6b45ab2e6c3677"} Jun 02 01:27:52.823507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:52.823479 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:27:52.824268 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:52.824243 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:27:52.827883 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:52.827865 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:27:52.828270 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:52.828251 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:27:52.834125 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:52.834105 2609 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:27:56.983366 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:56.983331 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5zh6l" event={"ID":"02122a14-5e0b-464b-a926-8b1315b02b0a","Type":"ContainerStarted","Data":"62a5ac5c8ead3f8c3978d1a67680997abb91696437c7f7a6c5d470bf03726c60"} Jun 02 01:27:57.001185 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:27:57.001138 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5zh6l" podStartSLOduration=0.623904083 podStartE2EDuration="6.001125022s" podCreationTimestamp="2026-06-02 01:27:51 +0000 UTC" firstStartedPulling="2026-06-02 01:27:51.463315589 +0000 UTC m=+299.158237871" lastFinishedPulling="2026-06-02 01:27:56.840536531 +0000 UTC m=+304.535458810" observedRunningTime="2026-06-02 01:27:56.999371675 +0000 UTC m=+304.694293977" watchObservedRunningTime="2026-06-02 01:27:57.001125022 +0000 UTC m=+304.696047324" Jun 02 01:28:02.554702 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.554659 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p"] Jun 02 01:28:02.558361 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.558340 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.560739 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.560716 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vc5v\"" Jun 02 01:28:02.560850 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.560721 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:28:02.561459 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.561443 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:28:02.572965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.572949 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p"] Jun 02 01:28:02.616406 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.616374 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.616562 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.616465 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfm5j\" (UniqueName: \"kubernetes.io/projected/c1564686-d27f-41a8-9a84-1ea97634fdfb-kube-api-access-wfm5j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.616562 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.616515 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.716945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.716896 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.717083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.716985 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wfm5j\" (UniqueName: \"kubernetes.io/projected/c1564686-d27f-41a8-9a84-1ea97634fdfb-kube-api-access-wfm5j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.717083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.717017 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.717296 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.717277 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.717373 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.717304 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.725584 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.725560 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfm5j\" (UniqueName: \"kubernetes.io/projected/c1564686-d27f-41a8-9a84-1ea97634fdfb-kube-api-access-wfm5j\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.867626 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.867556 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:02.993854 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.993811 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p"] Jun 02 01:28:02.995957 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:28:02.995928 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1564686_d27f_41a8_9a84_1ea97634fdfb.slice/crio-641ed6c7efe9a7586a813fe15c7cd39e797d454e46013f22c04dad72b06b5fec WatchSource:0}: Error finding container 641ed6c7efe9a7586a813fe15c7cd39e797d454e46013f22c04dad72b06b5fec: Status 404 returned error can't find the container with id 641ed6c7efe9a7586a813fe15c7cd39e797d454e46013f22c04dad72b06b5fec Jun 02 01:28:02.997791 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.997763 2609 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:28:02.999997 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:02.999966 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" event={"ID":"c1564686-d27f-41a8-9a84-1ea97634fdfb","Type":"ContainerStarted","Data":"641ed6c7efe9a7586a813fe15c7cd39e797d454e46013f22c04dad72b06b5fec"} Jun 02 01:28:11.026565 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:11.026510 2609 generic.go:358] "Generic (PLEG): container finished" podID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerID="f59e7dbc0bb34fd8bc5b7d0f4a312741e60afea8c6d662f54b1613fe720a2c48" exitCode=0 Jun 02 01:28:11.026565 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:11.026552 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" event={"ID":"c1564686-d27f-41a8-9a84-1ea97634fdfb","Type":"ContainerDied","Data":"f59e7dbc0bb34fd8bc5b7d0f4a312741e60afea8c6d662f54b1613fe720a2c48"} Jun 02 01:28:14.037044 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:14.037003 2609 generic.go:358] "Generic (PLEG): container finished" podID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerID="77782c62e295325e06a1bfe40d95020d349b0e020740a5f322622eed28ab55f7" exitCode=0 Jun 02 01:28:14.037420 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:14.037089 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" event={"ID":"c1564686-d27f-41a8-9a84-1ea97634fdfb","Type":"ContainerDied","Data":"77782c62e295325e06a1bfe40d95020d349b0e020740a5f322622eed28ab55f7"} Jun 02 01:28:23.065170 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:23.065139 2609 generic.go:358] "Generic (PLEG): container finished" podID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerID="ab835136c6fda0cadfc091cf950310ee4c41721c9ea19ccab9c178bd68cb5386" exitCode=0 Jun 02 01:28:23.065575 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:23.065187 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" event={"ID":"c1564686-d27f-41a8-9a84-1ea97634fdfb","Type":"ContainerDied","Data":"ab835136c6fda0cadfc091cf950310ee4c41721c9ea19ccab9c178bd68cb5386"} Jun 02 01:28:24.191611 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.191589 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:24.300492 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.300469 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfm5j\" (UniqueName: \"kubernetes.io/projected/c1564686-d27f-41a8-9a84-1ea97634fdfb-kube-api-access-wfm5j\") pod \"c1564686-d27f-41a8-9a84-1ea97634fdfb\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " Jun 02 01:28:24.300647 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.300569 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-bundle\") pod \"c1564686-d27f-41a8-9a84-1ea97634fdfb\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " Jun 02 01:28:24.300647 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.300606 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-util\") pod \"c1564686-d27f-41a8-9a84-1ea97634fdfb\" (UID: \"c1564686-d27f-41a8-9a84-1ea97634fdfb\") " Jun 02 01:28:24.301221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.301197 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-bundle" (OuterVolumeSpecName: "bundle") pod "c1564686-d27f-41a8-9a84-1ea97634fdfb" (UID: "c1564686-d27f-41a8-9a84-1ea97634fdfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:28:24.302740 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.302717 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1564686-d27f-41a8-9a84-1ea97634fdfb-kube-api-access-wfm5j" (OuterVolumeSpecName: "kube-api-access-wfm5j") pod "c1564686-d27f-41a8-9a84-1ea97634fdfb" (UID: "c1564686-d27f-41a8-9a84-1ea97634fdfb"). InnerVolumeSpecName "kube-api-access-wfm5j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:28:24.305568 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.305540 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-util" (OuterVolumeSpecName: "util") pod "c1564686-d27f-41a8-9a84-1ea97634fdfb" (UID: "c1564686-d27f-41a8-9a84-1ea97634fdfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:28:24.401541 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.401473 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfm5j\" (UniqueName: \"kubernetes.io/projected/c1564686-d27f-41a8-9a84-1ea97634fdfb-kube-api-access-wfm5j\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:28:24.401541 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.401496 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:28:24.401541 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:24.401506 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1564686-d27f-41a8-9a84-1ea97634fdfb-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:28:25.073031 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:25.073005 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" Jun 02 01:28:25.073172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:25.072988 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlfz7p" event={"ID":"c1564686-d27f-41a8-9a84-1ea97634fdfb","Type":"ContainerDied","Data":"641ed6c7efe9a7586a813fe15c7cd39e797d454e46013f22c04dad72b06b5fec"} Jun 02 01:28:25.073172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:25.073119 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="641ed6c7efe9a7586a813fe15c7cd39e797d454e46013f22c04dad72b06b5fec" Jun 02 01:28:30.353217 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353179 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl"] Jun 02 01:28:30.353678 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353584 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerName="util" Jun 02 01:28:30.353678 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353597 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerName="util" Jun 02 01:28:30.353678 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353607 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerName="pull" Jun 02 01:28:30.353678 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353616 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerName="pull" Jun 02 01:28:30.353678 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353637 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerName="extract" Jun 02 01:28:30.353678 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353643 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerName="extract" Jun 02 01:28:30.353935 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.353694 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="c1564686-d27f-41a8-9a84-1ea97634fdfb" containerName="extract" Jun 02 01:28:30.394848 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.394816 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl"] Jun 02 01:28:30.395004 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.394888 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.397934 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.397911 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 02 01:28:30.398053 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.397983 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:28:30.398053 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.397995 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-rgqgx\"" Jun 02 01:28:30.555617 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.555577 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krlz6\" (UniqueName: \"kubernetes.io/projected/5345afba-d631-4956-b271-186f358fb35f-kube-api-access-krlz6\") pod \"cert-manager-operator-controller-manager-54b9655956-925zl\" (UID: \"5345afba-d631-4956-b271-186f358fb35f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.555617 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.555620 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5345afba-d631-4956-b271-186f358fb35f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-925zl\" (UID: \"5345afba-d631-4956-b271-186f358fb35f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.656443 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.656370 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krlz6\" (UniqueName: \"kubernetes.io/projected/5345afba-d631-4956-b271-186f358fb35f-kube-api-access-krlz6\") pod \"cert-manager-operator-controller-manager-54b9655956-925zl\" (UID: \"5345afba-d631-4956-b271-186f358fb35f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.656443 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.656404 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5345afba-d631-4956-b271-186f358fb35f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-925zl\" (UID: \"5345afba-d631-4956-b271-186f358fb35f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.656753 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.656737 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5345afba-d631-4956-b271-186f358fb35f-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-925zl\" (UID: \"5345afba-d631-4956-b271-186f358fb35f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.666221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.666186 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krlz6\" (UniqueName: \"kubernetes.io/projected/5345afba-d631-4956-b271-186f358fb35f-kube-api-access-krlz6\") pod \"cert-manager-operator-controller-manager-54b9655956-925zl\" (UID: \"5345afba-d631-4956-b271-186f358fb35f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.704485 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.704465 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" Jun 02 01:28:30.836414 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:30.836384 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl"] Jun 02 01:28:30.840008 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:28:30.839978 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5345afba_d631_4956_b271_186f358fb35f.slice/crio-06df8e26a056a024e061a731405c15b7645941dedc86df9fa6bd75a61cc70f48 WatchSource:0}: Error finding container 06df8e26a056a024e061a731405c15b7645941dedc86df9fa6bd75a61cc70f48: Status 404 returned error can't find the container with id 06df8e26a056a024e061a731405c15b7645941dedc86df9fa6bd75a61cc70f48 Jun 02 01:28:31.093587 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:31.093558 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" event={"ID":"5345afba-d631-4956-b271-186f358fb35f","Type":"ContainerStarted","Data":"06df8e26a056a024e061a731405c15b7645941dedc86df9fa6bd75a61cc70f48"} Jun 02 01:28:33.102021 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:33.101983 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" event={"ID":"5345afba-d631-4956-b271-186f358fb35f","Type":"ContainerStarted","Data":"7fe31c2948286d91dad0eff5db92f74aab0d5a21509681b7e52ebc8de93f39d5"} Jun 02 01:28:33.120917 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:33.120873 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-925zl" podStartSLOduration=1.4150996120000001 podStartE2EDuration="3.120860506s" podCreationTimestamp="2026-06-02 01:28:30 +0000 UTC" firstStartedPulling="2026-06-02 01:28:30.843360691 +0000 UTC m=+338.538282977" lastFinishedPulling="2026-06-02 01:28:32.549121579 +0000 UTC m=+340.244043871" observedRunningTime="2026-06-02 01:28:33.120361597 +0000 UTC m=+340.815283922" watchObservedRunningTime="2026-06-02 01:28:33.120860506 +0000 UTC m=+340.815782807" Jun 02 01:28:35.002850 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.002818 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt"] Jun 02 01:28:35.005218 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.005203 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.007474 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.007452 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:28:35.007889 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.007872 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:28:35.008455 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.008437 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vc5v\"" Jun 02 01:28:35.013240 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.013214 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt"] Jun 02 01:28:35.021886 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.021864 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jnmrl"] Jun 02 01:28:35.024564 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.024545 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.026639 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.026616 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 01:28:35.026724 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.026663 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jq6rg\"" Jun 02 01:28:35.026793 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.026753 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 01:28:35.031768 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.031749 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jnmrl"] Jun 02 01:28:35.091694 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.091670 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35823182-d9b8-4b63-b3b5-dbde97b2cd30-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jnmrl\" (UID: \"35823182-d9b8-4b63-b3b5-dbde97b2cd30\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.091800 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.091718 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f8qn\" (UniqueName: \"kubernetes.io/projected/35823182-d9b8-4b63-b3b5-dbde97b2cd30-kube-api-access-7f8qn\") pod \"cert-manager-webhook-587ccfb98-jnmrl\" (UID: \"35823182-d9b8-4b63-b3b5-dbde97b2cd30\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.192154 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.192128 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.192271 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.192166 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7f8qn\" (UniqueName: \"kubernetes.io/projected/35823182-d9b8-4b63-b3b5-dbde97b2cd30-kube-api-access-7f8qn\") pod \"cert-manager-webhook-587ccfb98-jnmrl\" (UID: \"35823182-d9b8-4b63-b3b5-dbde97b2cd30\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.192271 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.192192 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm298\" (UniqueName: \"kubernetes.io/projected/af672237-0950-4426-9679-b9a08bd5fa56-kube-api-access-dm298\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.192271 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.192226 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35823182-d9b8-4b63-b3b5-dbde97b2cd30-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jnmrl\" (UID: \"35823182-d9b8-4b63-b3b5-dbde97b2cd30\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.192271 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.192252 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.200114 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.200085 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35823182-d9b8-4b63-b3b5-dbde97b2cd30-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-jnmrl\" (UID: \"35823182-d9b8-4b63-b3b5-dbde97b2cd30\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.200204 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.200151 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f8qn\" (UniqueName: \"kubernetes.io/projected/35823182-d9b8-4b63-b3b5-dbde97b2cd30-kube-api-access-7f8qn\") pod \"cert-manager-webhook-587ccfb98-jnmrl\" (UID: \"35823182-d9b8-4b63-b3b5-dbde97b2cd30\") " pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.292983 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.292924 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.292983 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.292971 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.293156 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.293000 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dm298\" (UniqueName: \"kubernetes.io/projected/af672237-0950-4426-9679-b9a08bd5fa56-kube-api-access-dm298\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.293255 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.293235 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.293320 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.293281 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.301375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.301355 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm298\" (UniqueName: \"kubernetes.io/projected/af672237-0950-4426-9679-b9a08bd5fa56-kube-api-access-dm298\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.315205 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.315184 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:35.345514 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.345490 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:35.454649 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.454626 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt"] Jun 02 01:28:35.457235 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:28:35.457204 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf672237_0950_4426_9679_b9a08bd5fa56.slice/crio-ff6039a8a55f286fdfa2cdf26c92d1f2a3669ec1e464fa179d9177bcd137d73e WatchSource:0}: Error finding container ff6039a8a55f286fdfa2cdf26c92d1f2a3669ec1e464fa179d9177bcd137d73e: Status 404 returned error can't find the container with id ff6039a8a55f286fdfa2cdf26c92d1f2a3669ec1e464fa179d9177bcd137d73e Jun 02 01:28:35.482798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:35.482773 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-jnmrl"] Jun 02 01:28:35.487667 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:28:35.487642 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35823182_d9b8_4b63_b3b5_dbde97b2cd30.slice/crio-0af6912612a193913582f3e7c993d732022a9f252329d3435bbe3f2a3d4cb182 WatchSource:0}: Error finding container 0af6912612a193913582f3e7c993d732022a9f252329d3435bbe3f2a3d4cb182: Status 404 returned error can't find the container with id 0af6912612a193913582f3e7c993d732022a9f252329d3435bbe3f2a3d4cb182 Jun 02 01:28:36.113435 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:36.113348 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" event={"ID":"35823182-d9b8-4b63-b3b5-dbde97b2cd30","Type":"ContainerStarted","Data":"0af6912612a193913582f3e7c993d732022a9f252329d3435bbe3f2a3d4cb182"} Jun 02 01:28:36.114609 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:36.114582 2609 generic.go:358] "Generic (PLEG): container finished" podID="af672237-0950-4426-9679-b9a08bd5fa56" containerID="655b5aae966cd0c59b6251dbd1890008765fdcf0b3a2c4568c356131b3d68516" exitCode=0 Jun 02 01:28:36.114706 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:36.114665 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" event={"ID":"af672237-0950-4426-9679-b9a08bd5fa56","Type":"ContainerDied","Data":"655b5aae966cd0c59b6251dbd1890008765fdcf0b3a2c4568c356131b3d68516"} Jun 02 01:28:36.114706 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:36.114690 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" event={"ID":"af672237-0950-4426-9679-b9a08bd5fa56","Type":"ContainerStarted","Data":"ff6039a8a55f286fdfa2cdf26c92d1f2a3669ec1e464fa179d9177bcd137d73e"} Jun 02 01:28:38.622016 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.621982 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-wgmxz"] Jun 02 01:28:38.624558 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.624512 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:38.626619 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.626591 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4v4vx\"" Jun 02 01:28:38.634507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.634485 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-wgmxz"] Jun 02 01:28:38.722500 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.722466 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7f23a27-b42e-462b-8546-3bf2c093c7ec-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-wgmxz\" (UID: \"f7f23a27-b42e-462b-8546-3bf2c093c7ec\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:38.722685 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.722544 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4k5l\" (UniqueName: \"kubernetes.io/projected/f7f23a27-b42e-462b-8546-3bf2c093c7ec-kube-api-access-m4k5l\") pod \"cert-manager-cainjector-68b757865b-wgmxz\" (UID: \"f7f23a27-b42e-462b-8546-3bf2c093c7ec\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:38.823968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.823926 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7f23a27-b42e-462b-8546-3bf2c093c7ec-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-wgmxz\" (UID: \"f7f23a27-b42e-462b-8546-3bf2c093c7ec\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:38.824139 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.823994 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4k5l\" (UniqueName: \"kubernetes.io/projected/f7f23a27-b42e-462b-8546-3bf2c093c7ec-kube-api-access-m4k5l\") pod \"cert-manager-cainjector-68b757865b-wgmxz\" (UID: \"f7f23a27-b42e-462b-8546-3bf2c093c7ec\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:38.832316 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.832285 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f7f23a27-b42e-462b-8546-3bf2c093c7ec-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-wgmxz\" (UID: \"f7f23a27-b42e-462b-8546-3bf2c093c7ec\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:38.832582 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.832555 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4k5l\" (UniqueName: \"kubernetes.io/projected/f7f23a27-b42e-462b-8546-3bf2c093c7ec-kube-api-access-m4k5l\") pod \"cert-manager-cainjector-68b757865b-wgmxz\" (UID: \"f7f23a27-b42e-462b-8546-3bf2c093c7ec\") " pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:38.935936 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:38.935908 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" Jun 02 01:28:39.311332 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:39.311302 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-wgmxz"] Jun 02 01:28:39.314568 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:28:39.314507 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7f23a27_b42e_462b_8546_3bf2c093c7ec.slice/crio-dcbf9a0413149ac2a4ce3dc75076eac04a31fa29c472e723f62b39d868f2920e WatchSource:0}: Error finding container dcbf9a0413149ac2a4ce3dc75076eac04a31fa29c472e723f62b39d868f2920e: Status 404 returned error can't find the container with id dcbf9a0413149ac2a4ce3dc75076eac04a31fa29c472e723f62b39d868f2920e Jun 02 01:28:40.133098 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.133007 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" event={"ID":"35823182-d9b8-4b63-b3b5-dbde97b2cd30","Type":"ContainerStarted","Data":"4fb0d92fbf691398947ac9cf4670a6afc5a85b89f4ae4cb6cb0ee374613da506"} Jun 02 01:28:40.133098 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.133068 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:40.134628 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.134602 2609 generic.go:358] "Generic (PLEG): container finished" podID="af672237-0950-4426-9679-b9a08bd5fa56" containerID="c031cc05943e17cfdede2a620577a3630b9ef642ce94704faf0cfc629a0bcfcd" exitCode=0 Jun 02 01:28:40.134751 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.134676 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" event={"ID":"af672237-0950-4426-9679-b9a08bd5fa56","Type":"ContainerDied","Data":"c031cc05943e17cfdede2a620577a3630b9ef642ce94704faf0cfc629a0bcfcd"} Jun 02 01:28:40.136025 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.136007 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" event={"ID":"f7f23a27-b42e-462b-8546-3bf2c093c7ec","Type":"ContainerStarted","Data":"74af27a9d060fd62d79bd46506644b5979915b1722570a89b54a5571b1291b15"} Jun 02 01:28:40.136115 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.136032 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" event={"ID":"f7f23a27-b42e-462b-8546-3bf2c093c7ec","Type":"ContainerStarted","Data":"dcbf9a0413149ac2a4ce3dc75076eac04a31fa29c472e723f62b39d868f2920e"} Jun 02 01:28:40.148375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.148133 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" podStartSLOduration=1.456970846 podStartE2EDuration="5.148121476s" podCreationTimestamp="2026-06-02 01:28:35 +0000 UTC" firstStartedPulling="2026-06-02 01:28:35.48955823 +0000 UTC m=+343.184480512" lastFinishedPulling="2026-06-02 01:28:39.18070886 +0000 UTC m=+346.875631142" observedRunningTime="2026-06-02 01:28:40.147014563 +0000 UTC m=+347.841936864" watchObservedRunningTime="2026-06-02 01:28:40.148121476 +0000 UTC m=+347.843043779" Jun 02 01:28:40.177826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:40.177788 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-wgmxz" podStartSLOduration=2.177776603 podStartE2EDuration="2.177776603s" podCreationTimestamp="2026-06-02 01:28:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:28:40.177145166 +0000 UTC m=+347.872067469" watchObservedRunningTime="2026-06-02 01:28:40.177776603 +0000 UTC m=+347.872698904" Jun 02 01:28:41.141184 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:41.141151 2609 generic.go:358] "Generic (PLEG): container finished" podID="af672237-0950-4426-9679-b9a08bd5fa56" containerID="31b7f86b27592f9de3e43685cb52646d78f2e34a4cc8caf7ed601ab6a5da67fe" exitCode=0 Jun 02 01:28:41.141642 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:41.141235 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" event={"ID":"af672237-0950-4426-9679-b9a08bd5fa56","Type":"ContainerDied","Data":"31b7f86b27592f9de3e43685cb52646d78f2e34a4cc8caf7ed601ab6a5da67fe"} Jun 02 01:28:42.269182 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.269155 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:42.353331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.353281 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-util\") pod \"af672237-0950-4426-9679-b9a08bd5fa56\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " Jun 02 01:28:42.353555 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.353387 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-bundle\") pod \"af672237-0950-4426-9679-b9a08bd5fa56\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " Jun 02 01:28:42.353555 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.353439 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm298\" (UniqueName: \"kubernetes.io/projected/af672237-0950-4426-9679-b9a08bd5fa56-kube-api-access-dm298\") pod \"af672237-0950-4426-9679-b9a08bd5fa56\" (UID: \"af672237-0950-4426-9679-b9a08bd5fa56\") " Jun 02 01:28:42.353827 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.353793 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-bundle" (OuterVolumeSpecName: "bundle") pod "af672237-0950-4426-9679-b9a08bd5fa56" (UID: "af672237-0950-4426-9679-b9a08bd5fa56"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:28:42.355668 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.355645 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af672237-0950-4426-9679-b9a08bd5fa56-kube-api-access-dm298" (OuterVolumeSpecName: "kube-api-access-dm298") pod "af672237-0950-4426-9679-b9a08bd5fa56" (UID: "af672237-0950-4426-9679-b9a08bd5fa56"). InnerVolumeSpecName "kube-api-access-dm298". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:28:42.357837 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.357804 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-util" (OuterVolumeSpecName: "util") pod "af672237-0950-4426-9679-b9a08bd5fa56" (UID: "af672237-0950-4426-9679-b9a08bd5fa56"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:28:42.454672 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.454639 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm298\" (UniqueName: \"kubernetes.io/projected/af672237-0950-4426-9679-b9a08bd5fa56-kube-api-access-dm298\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:28:42.454672 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.454669 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:28:42.454672 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:42.454678 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/af672237-0950-4426-9679-b9a08bd5fa56-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:28:43.148998 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:43.148962 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" event={"ID":"af672237-0950-4426-9679-b9a08bd5fa56","Type":"ContainerDied","Data":"ff6039a8a55f286fdfa2cdf26c92d1f2a3669ec1e464fa179d9177bcd137d73e"} Jun 02 01:28:43.148998 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:43.148999 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff6039a8a55f286fdfa2cdf26c92d1f2a3669ec1e464fa179d9177bcd137d73e" Jun 02 01:28:43.149185 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:43.149028 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flq8bt" Jun 02 01:28:44.090890 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.090781 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bmjbt"] Jun 02 01:28:44.091936 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.091910 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af672237-0950-4426-9679-b9a08bd5fa56" containerName="pull" Jun 02 01:28:44.091936 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.091936 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="af672237-0950-4426-9679-b9a08bd5fa56" containerName="pull" Jun 02 01:28:44.092122 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.091974 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af672237-0950-4426-9679-b9a08bd5fa56" containerName="util" Jun 02 01:28:44.092122 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.092002 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="af672237-0950-4426-9679-b9a08bd5fa56" containerName="util" Jun 02 01:28:44.092122 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.092019 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af672237-0950-4426-9679-b9a08bd5fa56" containerName="extract" Jun 02 01:28:44.092122 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.092029 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="af672237-0950-4426-9679-b9a08bd5fa56" containerName="extract" Jun 02 01:28:44.092122 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.092108 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="af672237-0950-4426-9679-b9a08bd5fa56" containerName="extract" Jun 02 01:28:44.096428 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.096409 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.098933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.098912 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-m7nbp\"" Jun 02 01:28:44.103960 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.103939 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bmjbt"] Jun 02 01:28:44.166808 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.166781 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdvt6\" (UniqueName: \"kubernetes.io/projected/92abe53a-1c94-4576-8906-09b106fa142b-kube-api-access-mdvt6\") pod \"cert-manager-79c8d999ff-bmjbt\" (UID: \"92abe53a-1c94-4576-8906-09b106fa142b\") " pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.166945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.166827 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92abe53a-1c94-4576-8906-09b106fa142b-bound-sa-token\") pod \"cert-manager-79c8d999ff-bmjbt\" (UID: \"92abe53a-1c94-4576-8906-09b106fa142b\") " pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.267720 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.267694 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92abe53a-1c94-4576-8906-09b106fa142b-bound-sa-token\") pod \"cert-manager-79c8d999ff-bmjbt\" (UID: \"92abe53a-1c94-4576-8906-09b106fa142b\") " pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.267828 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.267745 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mdvt6\" (UniqueName: \"kubernetes.io/projected/92abe53a-1c94-4576-8906-09b106fa142b-kube-api-access-mdvt6\") pod \"cert-manager-79c8d999ff-bmjbt\" (UID: \"92abe53a-1c94-4576-8906-09b106fa142b\") " pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.275644 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.275612 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92abe53a-1c94-4576-8906-09b106fa142b-bound-sa-token\") pod \"cert-manager-79c8d999ff-bmjbt\" (UID: \"92abe53a-1c94-4576-8906-09b106fa142b\") " pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.275737 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.275703 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdvt6\" (UniqueName: \"kubernetes.io/projected/92abe53a-1c94-4576-8906-09b106fa142b-kube-api-access-mdvt6\") pod \"cert-manager-79c8d999ff-bmjbt\" (UID: \"92abe53a-1c94-4576-8906-09b106fa142b\") " pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.406342 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.406256 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bmjbt" Jun 02 01:28:44.529703 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:44.529678 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bmjbt"] Jun 02 01:28:44.532076 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:28:44.532043 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92abe53a_1c94_4576_8906_09b106fa142b.slice/crio-cb196a80c8420965bff20290805e4631a646f73f83c012198ff2571fc816bdf0 WatchSource:0}: Error finding container cb196a80c8420965bff20290805e4631a646f73f83c012198ff2571fc816bdf0: Status 404 returned error can't find the container with id cb196a80c8420965bff20290805e4631a646f73f83c012198ff2571fc816bdf0 Jun 02 01:28:45.161806 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:45.161768 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bmjbt" event={"ID":"92abe53a-1c94-4576-8906-09b106fa142b","Type":"ContainerStarted","Data":"6fcfdede1b1defd298be1abe9c8291e7a0732f2190d2c0a18309e3e9abb8c573"} Jun 02 01:28:45.161806 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:45.161810 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bmjbt" event={"ID":"92abe53a-1c94-4576-8906-09b106fa142b","Type":"ContainerStarted","Data":"cb196a80c8420965bff20290805e4631a646f73f83c012198ff2571fc816bdf0"} Jun 02 01:28:45.179945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:45.179896 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-bmjbt" podStartSLOduration=1.17988186 podStartE2EDuration="1.17988186s" podCreationTimestamp="2026-06-02 01:28:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:28:45.178595318 +0000 UTC m=+352.873517621" watchObservedRunningTime="2026-06-02 01:28:45.17988186 +0000 UTC m=+352.874804163" Jun 02 01:28:46.143842 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:46.143811 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-jnmrl" Jun 02 01:28:58.895796 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.895760 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb"] Jun 02 01:28:58.898631 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.898615 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:58.901168 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.901138 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vc5v\"" Jun 02 01:28:58.901280 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.901180 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:28:58.901870 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.901855 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:28:58.909339 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.909317 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb"] Jun 02 01:28:58.983664 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.983628 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:58.983664 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.983669 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:58.983854 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:58.983696 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7hp8\" (UniqueName: \"kubernetes.io/projected/8948e093-bfa7-4a25-ada6-2a11b0e5b667-kube-api-access-x7hp8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.084510 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.084486 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.084655 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.084541 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.084655 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.084568 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7hp8\" (UniqueName: \"kubernetes.io/projected/8948e093-bfa7-4a25-ada6-2a11b0e5b667-kube-api-access-x7hp8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.084850 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.084831 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.084917 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.084897 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.092298 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.092277 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7hp8\" (UniqueName: \"kubernetes.io/projected/8948e093-bfa7-4a25-ada6-2a11b0e5b667-kube-api-access-x7hp8\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.208198 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.208174 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:28:59.338428 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:28:59.338393 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb"] Jun 02 01:28:59.342052 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:28:59.342027 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8948e093_bfa7_4a25_ada6_2a11b0e5b667.slice/crio-8f65287bb9e1ae6a128b2c8e695e042cf5d2cac43f444b41e64df456991aee09 WatchSource:0}: Error finding container 8f65287bb9e1ae6a128b2c8e695e042cf5d2cac43f444b41e64df456991aee09: Status 404 returned error can't find the container with id 8f65287bb9e1ae6a128b2c8e695e042cf5d2cac43f444b41e64df456991aee09 Jun 02 01:29:00.217849 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:00.217812 2609 generic.go:358] "Generic (PLEG): container finished" podID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerID="5c3695de2ecda3526b9b3be4ad21d6137aa9cf56b3bc8a8e6321064145313e2d" exitCode=0 Jun 02 01:29:00.218212 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:00.217904 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" event={"ID":"8948e093-bfa7-4a25-ada6-2a11b0e5b667","Type":"ContainerDied","Data":"5c3695de2ecda3526b9b3be4ad21d6137aa9cf56b3bc8a8e6321064145313e2d"} Jun 02 01:29:00.218212 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:00.217946 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" event={"ID":"8948e093-bfa7-4a25-ada6-2a11b0e5b667","Type":"ContainerStarted","Data":"8f65287bb9e1ae6a128b2c8e695e042cf5d2cac43f444b41e64df456991aee09"} Jun 02 01:29:01.222654 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:01.222621 2609 generic.go:358] "Generic (PLEG): container finished" podID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerID="74bb1f51755ec39eb21d788559802066ab76f79835edccaad55ffb74874a3bf4" exitCode=0 Jun 02 01:29:01.223026 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:01.222706 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" event={"ID":"8948e093-bfa7-4a25-ada6-2a11b0e5b667","Type":"ContainerDied","Data":"74bb1f51755ec39eb21d788559802066ab76f79835edccaad55ffb74874a3bf4"} Jun 02 01:29:02.228237 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:02.228195 2609 generic.go:358] "Generic (PLEG): container finished" podID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerID="a2672b1891610d2c5e814649e6fdb227b9aca7c848d0b1c9c6b25b8ae0b3a198" exitCode=0 Jun 02 01:29:02.228644 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:02.228273 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" event={"ID":"8948e093-bfa7-4a25-ada6-2a11b0e5b667","Type":"ContainerDied","Data":"a2672b1891610d2c5e814649e6fdb227b9aca7c848d0b1c9c6b25b8ae0b3a198"} Jun 02 01:29:03.358238 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.358219 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:29:03.422480 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.422454 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7hp8\" (UniqueName: \"kubernetes.io/projected/8948e093-bfa7-4a25-ada6-2a11b0e5b667-kube-api-access-x7hp8\") pod \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " Jun 02 01:29:03.422649 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.422494 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-util\") pod \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " Jun 02 01:29:03.422649 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.422518 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-bundle\") pod \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\" (UID: \"8948e093-bfa7-4a25-ada6-2a11b0e5b667\") " Jun 02 01:29:03.423194 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.423169 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-bundle" (OuterVolumeSpecName: "bundle") pod "8948e093-bfa7-4a25-ada6-2a11b0e5b667" (UID: "8948e093-bfa7-4a25-ada6-2a11b0e5b667"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:29:03.424611 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.424583 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8948e093-bfa7-4a25-ada6-2a11b0e5b667-kube-api-access-x7hp8" (OuterVolumeSpecName: "kube-api-access-x7hp8") pod "8948e093-bfa7-4a25-ada6-2a11b0e5b667" (UID: "8948e093-bfa7-4a25-ada6-2a11b0e5b667"). InnerVolumeSpecName "kube-api-access-x7hp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:29:03.428211 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.428170 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-util" (OuterVolumeSpecName: "util") pod "8948e093-bfa7-4a25-ada6-2a11b0e5b667" (UID: "8948e093-bfa7-4a25-ada6-2a11b0e5b667"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:29:03.523330 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.523257 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7hp8\" (UniqueName: \"kubernetes.io/projected/8948e093-bfa7-4a25-ada6-2a11b0e5b667-kube-api-access-x7hp8\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:03.523330 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.523283 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:03.523330 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:03.523292 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8948e093-bfa7-4a25-ada6-2a11b0e5b667-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:04.239590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:04.239554 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" event={"ID":"8948e093-bfa7-4a25-ada6-2a11b0e5b667","Type":"ContainerDied","Data":"8f65287bb9e1ae6a128b2c8e695e042cf5d2cac43f444b41e64df456991aee09"} Jun 02 01:29:04.239590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:04.239593 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f65287bb9e1ae6a128b2c8e695e042cf5d2cac43f444b41e64df456991aee09" Jun 02 01:29:04.239825 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:04.239612 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd642wb" Jun 02 01:29:11.621294 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621260 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm"] Jun 02 01:29:11.621831 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621813 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerName="extract" Jun 02 01:29:11.621921 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621834 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerName="extract" Jun 02 01:29:11.621921 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621851 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerName="util" Jun 02 01:29:11.621921 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621859 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerName="util" Jun 02 01:29:11.621921 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621877 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerName="pull" Jun 02 01:29:11.621921 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621885 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerName="pull" Jun 02 01:29:11.622159 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.621983 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="8948e093-bfa7-4a25-ada6-2a11b0e5b667" containerName="extract" Jun 02 01:29:11.660747 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.660721 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm"] Jun 02 01:29:11.660895 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.660829 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.663814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.663794 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:29:11.664098 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.664081 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:29:11.664474 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.664457 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:29:11.684370 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.684348 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-56xw8\"" Jun 02 01:29:11.689947 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.689926 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:29:11.787748 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.787729 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a76468f8-101c-4354-aa6c-2294a0491e2e-tmp\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.787848 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.787771 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8phd\" (UniqueName: \"kubernetes.io/projected/a76468f8-101c-4354-aa6c-2294a0491e2e-kube-api-access-w8phd\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.787848 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.787791 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a76468f8-101c-4354-aa6c-2294a0491e2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.787848 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.787830 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a76468f8-101c-4354-aa6c-2294a0491e2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.787950 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.787861 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a76468f8-101c-4354-aa6c-2294a0491e2e-manifests\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.888267 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.888204 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a76468f8-101c-4354-aa6c-2294a0491e2e-tmp\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.888369 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.888266 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8phd\" (UniqueName: \"kubernetes.io/projected/a76468f8-101c-4354-aa6c-2294a0491e2e-kube-api-access-w8phd\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.888369 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.888298 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a76468f8-101c-4354-aa6c-2294a0491e2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.888369 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.888326 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a76468f8-101c-4354-aa6c-2294a0491e2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.888491 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.888370 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a76468f8-101c-4354-aa6c-2294a0491e2e-manifests\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.888718 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.888690 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a76468f8-101c-4354-aa6c-2294a0491e2e-manifests\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.890486 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.890466 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a76468f8-101c-4354-aa6c-2294a0491e2e-tmp\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.890806 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.890786 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a76468f8-101c-4354-aa6c-2294a0491e2e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.890927 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.890905 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a76468f8-101c-4354-aa6c-2294a0491e2e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.904072 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.904047 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8phd\" (UniqueName: \"kubernetes.io/projected/a76468f8-101c-4354-aa6c-2294a0491e2e-kube-api-access-w8phd\") pod \"opendatahub-operator-controller-manager-6758f7c588-5kjfm\" (UID: \"a76468f8-101c-4354-aa6c-2294a0491e2e\") " pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:11.971199 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:11.971175 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:12.116395 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:12.116341 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm"] Jun 02 01:29:12.118817 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:29:12.118790 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda76468f8_101c_4354_aa6c_2294a0491e2e.slice/crio-5419ca13806ca9aba6ad9f5e462da709e36638a46d7abe9b1fe01b24e1b42858 WatchSource:0}: Error finding container 5419ca13806ca9aba6ad9f5e462da709e36638a46d7abe9b1fe01b24e1b42858: Status 404 returned error can't find the container with id 5419ca13806ca9aba6ad9f5e462da709e36638a46d7abe9b1fe01b24e1b42858 Jun 02 01:29:12.267638 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:12.267608 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" event={"ID":"a76468f8-101c-4354-aa6c-2294a0491e2e","Type":"ContainerStarted","Data":"5419ca13806ca9aba6ad9f5e462da709e36638a46d7abe9b1fe01b24e1b42858"} Jun 02 01:29:16.284019 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:16.283983 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" event={"ID":"a76468f8-101c-4354-aa6c-2294a0491e2e","Type":"ContainerStarted","Data":"845ceec2706110967464d22a33ac61ea3b1be52a2329fe92e6f37fc7f307264b"} Jun 02 01:29:17.289169 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:17.289133 2609 generic.go:358] "Generic (PLEG): container finished" podID="a76468f8-101c-4354-aa6c-2294a0491e2e" containerID="845ceec2706110967464d22a33ac61ea3b1be52a2329fe92e6f37fc7f307264b" exitCode=0 Jun 02 01:29:17.289550 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:17.289214 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" event={"ID":"a76468f8-101c-4354-aa6c-2294a0491e2e","Type":"ContainerDied","Data":"845ceec2706110967464d22a33ac61ea3b1be52a2329fe92e6f37fc7f307264b"} Jun 02 01:29:18.294283 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:18.294253 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" event={"ID":"a76468f8-101c-4354-aa6c-2294a0491e2e","Type":"ContainerStarted","Data":"f58fbbeb1d0e2d436f254df950924cf9d7bbf35671f886451e0bee4359bb8d28"} Jun 02 01:29:18.294700 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:18.294399 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:18.314295 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:18.314241 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" podStartSLOduration=1.735176896 podStartE2EDuration="7.314230036s" podCreationTimestamp="2026-06-02 01:29:11 +0000 UTC" firstStartedPulling="2026-06-02 01:29:12.120387712 +0000 UTC m=+379.815309992" lastFinishedPulling="2026-06-02 01:29:17.699440835 +0000 UTC m=+385.394363132" observedRunningTime="2026-06-02 01:29:18.313352133 +0000 UTC m=+386.008274454" watchObservedRunningTime="2026-06-02 01:29:18.314230036 +0000 UTC m=+386.009152338" Jun 02 01:29:29.300425 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:29.300396 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6758f7c588-5kjfm" Jun 02 01:29:31.905777 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.905740 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk"] Jun 02 01:29:31.913582 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.913559 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:31.916899 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.916877 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 01:29:31.917016 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.916932 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 01:29:31.917117 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.917078 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:29:31.917117 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.917099 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 01:29:31.917244 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.917140 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 01:29:31.917244 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.917140 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2rm82\"" Jun 02 01:29:31.923825 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.923806 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk"] Jun 02 01:29:31.963710 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.963684 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29afc0cf-e57f-4823-b96f-3df958da764e-cert\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:31.963815 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.963741 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnz9s\" (UniqueName: \"kubernetes.io/projected/29afc0cf-e57f-4823-b96f-3df958da764e-kube-api-access-rnz9s\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:31.963859 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.963817 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/29afc0cf-e57f-4823-b96f-3df958da764e-manager-config\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:31.963899 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:31.963861 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/29afc0cf-e57f-4823-b96f-3df958da764e-metrics-cert\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.064779 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.064744 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/29afc0cf-e57f-4823-b96f-3df958da764e-metrics-cert\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.064940 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.064797 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29afc0cf-e57f-4823-b96f-3df958da764e-cert\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.064940 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.064835 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnz9s\" (UniqueName: \"kubernetes.io/projected/29afc0cf-e57f-4823-b96f-3df958da764e-kube-api-access-rnz9s\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.064940 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.064866 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/29afc0cf-e57f-4823-b96f-3df958da764e-manager-config\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.065442 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.065421 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/29afc0cf-e57f-4823-b96f-3df958da764e-manager-config\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.067278 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.067260 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29afc0cf-e57f-4823-b96f-3df958da764e-cert\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.067339 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.067301 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/29afc0cf-e57f-4823-b96f-3df958da764e-metrics-cert\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.078220 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.078197 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnz9s\" (UniqueName: \"kubernetes.io/projected/29afc0cf-e57f-4823-b96f-3df958da764e-kube-api-access-rnz9s\") pod \"lws-controller-manager-6df7964bff-lrllk\" (UID: \"29afc0cf-e57f-4823-b96f-3df958da764e\") " pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.223606 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.223574 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:32.371857 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:32.371824 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk"] Jun 02 01:29:32.373785 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:29:32.373758 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29afc0cf_e57f_4823_b96f_3df958da764e.slice/crio-38cc77c9b4a06c74f6760a33162fbecf02e5dbd2c8889930542d74d55c85af0f WatchSource:0}: Error finding container 38cc77c9b4a06c74f6760a33162fbecf02e5dbd2c8889930542d74d55c85af0f: Status 404 returned error can't find the container with id 38cc77c9b4a06c74f6760a33162fbecf02e5dbd2c8889930542d74d55c85af0f Jun 02 01:29:33.363449 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:33.363415 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" event={"ID":"29afc0cf-e57f-4823-b96f-3df958da764e","Type":"ContainerStarted","Data":"38cc77c9b4a06c74f6760a33162fbecf02e5dbd2c8889930542d74d55c85af0f"} Jun 02 01:29:35.372536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:35.372487 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" event={"ID":"29afc0cf-e57f-4823-b96f-3df958da764e","Type":"ContainerStarted","Data":"42c36995ab1f0b56fe7d1439268087c35fbfadd45d97f8206a08b44dc5cd8329"} Jun 02 01:29:35.372915 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:35.372637 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:35.388815 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:35.388769 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" podStartSLOduration=2.090493364 podStartE2EDuration="4.3887577s" podCreationTimestamp="2026-06-02 01:29:31 +0000 UTC" firstStartedPulling="2026-06-02 01:29:32.375729626 +0000 UTC m=+400.070651906" lastFinishedPulling="2026-06-02 01:29:34.673993952 +0000 UTC m=+402.368916242" observedRunningTime="2026-06-02 01:29:35.38722514 +0000 UTC m=+403.082147441" watchObservedRunningTime="2026-06-02 01:29:35.3887577 +0000 UTC m=+403.083680002" Jun 02 01:29:36.014330 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.014294 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr"] Jun 02 01:29:36.017663 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.017648 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.019827 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.019807 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:29:36.019924 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.019837 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:29:36.020433 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.020412 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vc5v\"" Jun 02 01:29:36.023993 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.023974 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr"] Jun 02 01:29:36.097614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.097589 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.097735 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.097627 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27wrf\" (UniqueName: \"kubernetes.io/projected/84d1836d-0a41-481c-9adb-7ab6f14d824a-kube-api-access-27wrf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.097735 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.097654 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.198925 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.198898 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27wrf\" (UniqueName: \"kubernetes.io/projected/84d1836d-0a41-481c-9adb-7ab6f14d824a-kube-api-access-27wrf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.199035 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.198930 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.199035 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.198991 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.199279 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.199262 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.199331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.199302 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.207115 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.207095 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27wrf\" (UniqueName: \"kubernetes.io/projected/84d1836d-0a41-481c-9adb-7ab6f14d824a-kube-api-access-27wrf\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.327050 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.326980 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:36.462352 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:36.462326 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr"] Jun 02 01:29:36.464340 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:29:36.464312 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84d1836d_0a41_481c_9adb_7ab6f14d824a.slice/crio-3f9049b0f40f9eebd50449ca5db64bdd4a1cacc87d4e15d2c38eec982ed5d3b2 WatchSource:0}: Error finding container 3f9049b0f40f9eebd50449ca5db64bdd4a1cacc87d4e15d2c38eec982ed5d3b2: Status 404 returned error can't find the container with id 3f9049b0f40f9eebd50449ca5db64bdd4a1cacc87d4e15d2c38eec982ed5d3b2 Jun 02 01:29:37.381972 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:37.381935 2609 generic.go:358] "Generic (PLEG): container finished" podID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerID="b4fa9b8b908f32e4867e66efc9dcba41074ad1e40eb0756f6efbde928fd4b422" exitCode=0 Jun 02 01:29:37.382161 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:37.382021 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" event={"ID":"84d1836d-0a41-481c-9adb-7ab6f14d824a","Type":"ContainerDied","Data":"b4fa9b8b908f32e4867e66efc9dcba41074ad1e40eb0756f6efbde928fd4b422"} Jun 02 01:29:37.382161 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:37.382046 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" event={"ID":"84d1836d-0a41-481c-9adb-7ab6f14d824a","Type":"ContainerStarted","Data":"3f9049b0f40f9eebd50449ca5db64bdd4a1cacc87d4e15d2c38eec982ed5d3b2"} Jun 02 01:29:39.390906 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:39.390869 2609 generic.go:358] "Generic (PLEG): container finished" podID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerID="bdac90b1f14f72ee3b270ce67c5e33cead8a45aadf46b2763a2655c2c131356e" exitCode=0 Jun 02 01:29:39.391304 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:39.390965 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" event={"ID":"84d1836d-0a41-481c-9adb-7ab6f14d824a","Type":"ContainerDied","Data":"bdac90b1f14f72ee3b270ce67c5e33cead8a45aadf46b2763a2655c2c131356e"} Jun 02 01:29:40.396860 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:40.396822 2609 generic.go:358] "Generic (PLEG): container finished" podID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerID="c0548b581f0704bdb8751a2d85b553e00647ec496f099b515c8c567f1feaef55" exitCode=0 Jun 02 01:29:40.397227 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:40.396890 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" event={"ID":"84d1836d-0a41-481c-9adb-7ab6f14d824a","Type":"ContainerDied","Data":"c0548b581f0704bdb8751a2d85b553e00647ec496f099b515c8c567f1feaef55"} Jun 02 01:29:41.529821 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.529795 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:41.641583 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.641554 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-util\") pod \"84d1836d-0a41-481c-9adb-7ab6f14d824a\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " Jun 02 01:29:41.641753 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.641616 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-bundle\") pod \"84d1836d-0a41-481c-9adb-7ab6f14d824a\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " Jun 02 01:29:41.641753 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.641721 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27wrf\" (UniqueName: \"kubernetes.io/projected/84d1836d-0a41-481c-9adb-7ab6f14d824a-kube-api-access-27wrf\") pod \"84d1836d-0a41-481c-9adb-7ab6f14d824a\" (UID: \"84d1836d-0a41-481c-9adb-7ab6f14d824a\") " Jun 02 01:29:41.642444 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.642419 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-bundle" (OuterVolumeSpecName: "bundle") pod "84d1836d-0a41-481c-9adb-7ab6f14d824a" (UID: "84d1836d-0a41-481c-9adb-7ab6f14d824a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:29:41.643792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.643773 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84d1836d-0a41-481c-9adb-7ab6f14d824a-kube-api-access-27wrf" (OuterVolumeSpecName: "kube-api-access-27wrf") pod "84d1836d-0a41-481c-9adb-7ab6f14d824a" (UID: "84d1836d-0a41-481c-9adb-7ab6f14d824a"). InnerVolumeSpecName "kube-api-access-27wrf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:29:41.648973 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.648947 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-util" (OuterVolumeSpecName: "util") pod "84d1836d-0a41-481c-9adb-7ab6f14d824a" (UID: "84d1836d-0a41-481c-9adb-7ab6f14d824a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:29:41.742478 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.742450 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27wrf\" (UniqueName: \"kubernetes.io/projected/84d1836d-0a41-481c-9adb-7ab6f14d824a-kube-api-access-27wrf\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:41.742478 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.742474 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:41.742478 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:41.742484 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84d1836d-0a41-481c-9adb-7ab6f14d824a-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:42.406614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:42.406582 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" event={"ID":"84d1836d-0a41-481c-9adb-7ab6f14d824a","Type":"ContainerDied","Data":"3f9049b0f40f9eebd50449ca5db64bdd4a1cacc87d4e15d2c38eec982ed5d3b2"} Jun 02 01:29:42.406614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:42.406617 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f9049b0f40f9eebd50449ca5db64bdd4a1cacc87d4e15d2c38eec982ed5d3b2" Jun 02 01:29:42.406859 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:42.406614 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835zbxmr" Jun 02 01:29:46.379806 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:46.379747 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6df7964bff-lrllk" Jun 02 01:29:51.142168 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142138 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz"] Jun 02 01:29:51.142515 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142494 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerName="util" Jun 02 01:29:51.142515 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142509 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerName="util" Jun 02 01:29:51.142621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142541 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerName="pull" Jun 02 01:29:51.142621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142546 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerName="pull" Jun 02 01:29:51.142621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142553 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerName="extract" Jun 02 01:29:51.142621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142558 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerName="extract" Jun 02 01:29:51.142773 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.142645 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="84d1836d-0a41-481c-9adb-7ab6f14d824a" containerName="extract" Jun 02 01:29:51.150106 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.150075 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.153569 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.153545 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vc5v\"" Jun 02 01:29:51.153730 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.153544 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:29:51.153730 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.153576 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:29:51.155358 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.155338 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz"] Jun 02 01:29:51.220070 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.220039 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.220219 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.220078 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l29gk\" (UniqueName: \"kubernetes.io/projected/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-kube-api-access-l29gk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.220219 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.220165 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.320666 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.320634 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.320799 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.320678 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.320799 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.320702 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l29gk\" (UniqueName: \"kubernetes.io/projected/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-kube-api-access-l29gk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.321005 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.320987 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.321042 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.321008 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.342056 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.342031 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l29gk\" (UniqueName: \"kubernetes.io/projected/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-kube-api-access-l29gk\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.460886 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.460860 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:51.603792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:51.603764 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz"] Jun 02 01:29:51.605494 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:29:51.605468 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8be8c8_c51d_40f3_a52e_c538dbdf8c49.slice/crio-92c2e767ee509c8cc316fe1cd9484d80ab000c0a5c3a2c78256a0e171609acc1 WatchSource:0}: Error finding container 92c2e767ee509c8cc316fe1cd9484d80ab000c0a5c3a2c78256a0e171609acc1: Status 404 returned error can't find the container with id 92c2e767ee509c8cc316fe1cd9484d80ab000c0a5c3a2c78256a0e171609acc1 Jun 02 01:29:52.445976 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:52.445939 2609 generic.go:358] "Generic (PLEG): container finished" podID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerID="070bca831b687d32433e838b0fbc7d1c48107911a4c46bca7ddf8ff966d40335" exitCode=0 Jun 02 01:29:52.446405 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:52.445985 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" event={"ID":"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49","Type":"ContainerDied","Data":"070bca831b687d32433e838b0fbc7d1c48107911a4c46bca7ddf8ff966d40335"} Jun 02 01:29:52.446405 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:52.446011 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" event={"ID":"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49","Type":"ContainerStarted","Data":"92c2e767ee509c8cc316fe1cd9484d80ab000c0a5c3a2c78256a0e171609acc1"} Jun 02 01:29:54.455475 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:54.455441 2609 generic.go:358] "Generic (PLEG): container finished" podID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerID="31c5b96f865b2c6cb1a72e7b63cd133de46ef3158ceb05e14f38cd41cce9c812" exitCode=0 Jun 02 01:29:54.455853 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:54.455537 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" event={"ID":"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49","Type":"ContainerDied","Data":"31c5b96f865b2c6cb1a72e7b63cd133de46ef3158ceb05e14f38cd41cce9c812"} Jun 02 01:29:55.461475 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:55.461437 2609 generic.go:358] "Generic (PLEG): container finished" podID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerID="3c0f651eed24064f8e1c11ed0e8a10ba50d3de68f64f4daff6978b746b85e133" exitCode=0 Jun 02 01:29:55.461865 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:55.461540 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" event={"ID":"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49","Type":"ContainerDied","Data":"3c0f651eed24064f8e1c11ed0e8a10ba50d3de68f64f4daff6978b746b85e133"} Jun 02 01:29:56.588450 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.588428 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:29:56.663665 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.663633 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l29gk\" (UniqueName: \"kubernetes.io/projected/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-kube-api-access-l29gk\") pod \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " Jun 02 01:29:56.663841 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.663679 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-bundle\") pod \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " Jun 02 01:29:56.663841 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.663721 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-util\") pod \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\" (UID: \"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49\") " Jun 02 01:29:56.664638 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.664609 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-bundle" (OuterVolumeSpecName: "bundle") pod "7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" (UID: "7e8be8c8-c51d-40f3-a52e-c538dbdf8c49"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:29:56.665852 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.665822 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-kube-api-access-l29gk" (OuterVolumeSpecName: "kube-api-access-l29gk") pod "7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" (UID: "7e8be8c8-c51d-40f3-a52e-c538dbdf8c49"). InnerVolumeSpecName "kube-api-access-l29gk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:29:56.669126 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.669086 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-util" (OuterVolumeSpecName: "util") pod "7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" (UID: "7e8be8c8-c51d-40f3-a52e-c538dbdf8c49"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:29:56.764325 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.764259 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:56.764325 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.764281 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l29gk\" (UniqueName: \"kubernetes.io/projected/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-kube-api-access-l29gk\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:56.764325 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:56.764294 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7e8be8c8-c51d-40f3-a52e-c538dbdf8c49-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:29:57.470406 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:57.470374 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" event={"ID":"7e8be8c8-c51d-40f3-a52e-c538dbdf8c49","Type":"ContainerDied","Data":"92c2e767ee509c8cc316fe1cd9484d80ab000c0a5c3a2c78256a0e171609acc1"} Jun 02 01:29:57.470406 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:57.470407 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92c2e767ee509c8cc316fe1cd9484d80ab000c0a5c3a2c78256a0e171609acc1" Jun 02 01:29:57.470637 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:29:57.470437 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762atg7sz" Jun 02 01:30:18.655963 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.655880 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n"] Jun 02 01:30:18.656423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.656264 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerName="pull" Jun 02 01:30:18.656423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.656276 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerName="pull" Jun 02 01:30:18.656423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.656284 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerName="util" Jun 02 01:30:18.656423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.656290 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerName="util" Jun 02 01:30:18.656423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.656300 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerName="extract" Jun 02 01:30:18.656423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.656309 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerName="extract" Jun 02 01:30:18.656423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.656364 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="7e8be8c8-c51d-40f3-a52e-c538dbdf8c49" containerName="extract" Jun 02 01:30:18.659917 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.659897 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.663039 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.662995 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:30:18.663303 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.663282 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fszcq\"" Jun 02 01:30:18.663412 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.663381 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:30:18.663504 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.663490 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 01:30:18.682488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.682466 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n"] Jun 02 01:30:18.744684 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744648 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.744684 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744696 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.744862 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744716 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.744862 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744753 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wh2f\" (UniqueName: \"kubernetes.io/projected/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-kube-api-access-7wh2f\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.744862 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744821 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.744862 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744851 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.745020 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744894 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.745020 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744910 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.745020 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.744945 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.845603 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845579 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.845738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845609 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.845738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845641 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.845738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845666 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wh2f\" (UniqueName: \"kubernetes.io/projected/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-kube-api-access-7wh2f\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.845738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845697 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.845738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845734 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846032 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845794 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846032 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845819 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846032 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.845878 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846183 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.846142 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846183 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.846167 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846289 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.846251 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846328 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.846305 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.846593 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.846575 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.848028 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.848007 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.848609 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.848589 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.853193 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.853166 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.853401 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.853382 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wh2f\" (UniqueName: \"kubernetes.io/projected/b2c87e14-e92c-4476-a6a6-1d111c18a0b1-kube-api-access-7wh2f\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n\" (UID: \"b2c87e14-e92c-4476-a6a6-1d111c18a0b1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:18.973411 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:18.973383 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:19.113208 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:19.113176 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n"] Jun 02 01:30:19.114231 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:30:19.114207 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c87e14_e92c_4476_a6a6_1d111c18a0b1.slice/crio-7e757e815cb441b6e6e56bfd522a48f698448afa134b7a7dd8dce8ad8d75d2c3 WatchSource:0}: Error finding container 7e757e815cb441b6e6e56bfd522a48f698448afa134b7a7dd8dce8ad8d75d2c3: Status 404 returned error can't find the container with id 7e757e815cb441b6e6e56bfd522a48f698448afa134b7a7dd8dce8ad8d75d2c3 Jun 02 01:30:19.548847 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:19.548812 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" event={"ID":"b2c87e14-e92c-4476-a6a6-1d111c18a0b1","Type":"ContainerStarted","Data":"7e757e815cb441b6e6e56bfd522a48f698448afa134b7a7dd8dce8ad8d75d2c3"} Jun 02 01:30:23.968638 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:23.968600 2609 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 01:30:23.968942 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:23.968673 2609 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 01:30:23.968942 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:23.968701 2609 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 01:30:24.571129 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.571090 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" event={"ID":"b2c87e14-e92c-4476-a6a6-1d111c18a0b1","Type":"ContainerStarted","Data":"d7bf51dbcb9feb3f6fb29572e1b4b14deac022d56bf7c118929ee9d789ef76c3"} Jun 02 01:30:24.591785 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.591729 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" podStartSLOduration=1.739831137 podStartE2EDuration="6.591712067s" podCreationTimestamp="2026-06-02 01:30:18 +0000 UTC" firstStartedPulling="2026-06-02 01:30:19.116466186 +0000 UTC m=+446.811388469" lastFinishedPulling="2026-06-02 01:30:23.968347119 +0000 UTC m=+451.663269399" observedRunningTime="2026-06-02 01:30:24.58906601 +0000 UTC m=+452.283988311" watchObservedRunningTime="2026-06-02 01:30:24.591712067 +0000 UTC m=+452.286634370" Jun 02 01:30:24.971079 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.971042 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7598c6c7c5-kgdsj"] Jun 02 01:30:24.975100 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.975067 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:24.975241 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.975187 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:24.977689 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.977651 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 01:30:24.977847 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.977723 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9dhrw\"" Jun 02 01:30:24.981412 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:24.981387 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7598c6c7c5-kgdsj"] Jun 02 01:30:25.101663 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.101629 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cca0008d-1f02-42c8-8de0-fb6668c94d4d-redirect-config\") pod \"dashboard-redirect-7598c6c7c5-kgdsj\" (UID: \"cca0008d-1f02-42c8-8de0-fb6668c94d4d\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:25.101829 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.101677 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-227q2\" (UniqueName: \"kubernetes.io/projected/cca0008d-1f02-42c8-8de0-fb6668c94d4d-kube-api-access-227q2\") pod \"dashboard-redirect-7598c6c7c5-kgdsj\" (UID: \"cca0008d-1f02-42c8-8de0-fb6668c94d4d\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:25.202497 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.202460 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cca0008d-1f02-42c8-8de0-fb6668c94d4d-redirect-config\") pod \"dashboard-redirect-7598c6c7c5-kgdsj\" (UID: \"cca0008d-1f02-42c8-8de0-fb6668c94d4d\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:25.202689 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.202548 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-227q2\" (UniqueName: \"kubernetes.io/projected/cca0008d-1f02-42c8-8de0-fb6668c94d4d-kube-api-access-227q2\") pod \"dashboard-redirect-7598c6c7c5-kgdsj\" (UID: \"cca0008d-1f02-42c8-8de0-fb6668c94d4d\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:25.203126 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.203107 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/cca0008d-1f02-42c8-8de0-fb6668c94d4d-redirect-config\") pod \"dashboard-redirect-7598c6c7c5-kgdsj\" (UID: \"cca0008d-1f02-42c8-8de0-fb6668c94d4d\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:25.210244 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.210224 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-227q2\" (UniqueName: \"kubernetes.io/projected/cca0008d-1f02-42c8-8de0-fb6668c94d4d-kube-api-access-227q2\") pod \"dashboard-redirect-7598c6c7c5-kgdsj\" (UID: \"cca0008d-1f02-42c8-8de0-fb6668c94d4d\") " pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:25.286728 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.286660 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" Jun 02 01:30:25.417611 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.417587 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7598c6c7c5-kgdsj"] Jun 02 01:30:25.418809 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:30:25.418787 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca0008d_1f02_42c8_8de0_fb6668c94d4d.slice/crio-96f98dd85106e9000f3251fd55908a50082e94252be96c4dafe0d1905e5c73d9 WatchSource:0}: Error finding container 96f98dd85106e9000f3251fd55908a50082e94252be96c4dafe0d1905e5c73d9: Status 404 returned error can't find the container with id 96f98dd85106e9000f3251fd55908a50082e94252be96c4dafe0d1905e5c73d9 Jun 02 01:30:25.576266 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.576180 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" event={"ID":"cca0008d-1f02-42c8-8de0-fb6668c94d4d","Type":"ContainerStarted","Data":"96f98dd85106e9000f3251fd55908a50082e94252be96c4dafe0d1905e5c73d9"} Jun 02 01:30:25.978290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:25.978265 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:26.580379 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:26.580343 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:26.581337 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:26.581318 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n" Jun 02 01:30:28.590946 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:28.590910 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" event={"ID":"cca0008d-1f02-42c8-8de0-fb6668c94d4d","Type":"ContainerStarted","Data":"b5559b6cb88401c5f55bfdef9a7c36719d797f5cd22192ec458274e26b52cd59"} Jun 02 01:30:28.607398 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:28.607348 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7598c6c7c5-kgdsj" podStartSLOduration=2.109390841 podStartE2EDuration="4.607336567s" podCreationTimestamp="2026-06-02 01:30:24 +0000 UTC" firstStartedPulling="2026-06-02 01:30:25.420203329 +0000 UTC m=+453.115125609" lastFinishedPulling="2026-06-02 01:30:27.918149053 +0000 UTC m=+455.613071335" observedRunningTime="2026-06-02 01:30:28.606130666 +0000 UTC m=+456.301052970" watchObservedRunningTime="2026-06-02 01:30:28.607336567 +0000 UTC m=+456.302258903" Jun 02 01:30:32.750508 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.750467 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vjdv"] Jun 02 01:30:32.753024 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.753003 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" Jun 02 01:30:32.755375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.755353 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:30:32.756163 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.756141 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:30:32.756264 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.756143 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-vsdsl\"" Jun 02 01:30:32.762605 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.762583 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vjdv"] Jun 02 01:30:32.767616 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.767592 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8c2b\" (UniqueName: \"kubernetes.io/projected/173c6270-e677-4786-b19e-20ac1e758702-kube-api-access-d8c2b\") pod \"kuadrant-operator-catalog-7vjdv\" (UID: \"173c6270-e677-4786-b19e-20ac1e758702\") " pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" Jun 02 01:30:32.869050 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.869013 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8c2b\" (UniqueName: \"kubernetes.io/projected/173c6270-e677-4786-b19e-20ac1e758702-kube-api-access-d8c2b\") pod \"kuadrant-operator-catalog-7vjdv\" (UID: \"173c6270-e677-4786-b19e-20ac1e758702\") " pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" Jun 02 01:30:32.876561 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:32.876506 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8c2b\" (UniqueName: \"kubernetes.io/projected/173c6270-e677-4786-b19e-20ac1e758702-kube-api-access-d8c2b\") pod \"kuadrant-operator-catalog-7vjdv\" (UID: \"173c6270-e677-4786-b19e-20ac1e758702\") " pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" Jun 02 01:30:33.064443 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.064369 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" Jun 02 01:30:33.103581 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.103547 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vjdv"] Jun 02 01:30:33.195334 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.195302 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vjdv"] Jun 02 01:30:33.196690 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:30:33.196660 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173c6270_e677_4786_b19e_20ac1e758702.slice/crio-49b179152c2d5ae807b5af61fd32090dfc5c9953e9cd46752e0c344a3b3dc09a WatchSource:0}: Error finding container 49b179152c2d5ae807b5af61fd32090dfc5c9953e9cd46752e0c344a3b3dc09a: Status 404 returned error can't find the container with id 49b179152c2d5ae807b5af61fd32090dfc5c9953e9cd46752e0c344a3b3dc09a Jun 02 01:30:33.312339 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.312307 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mggsr"] Jun 02 01:30:33.315162 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.315124 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:33.322380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.322361 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mggsr"] Jun 02 01:30:33.373261 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.373222 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pcdn\" (UniqueName: \"kubernetes.io/projected/fe3da251-e829-41d2-9dce-ab560b114834-kube-api-access-2pcdn\") pod \"kuadrant-operator-catalog-mggsr\" (UID: \"fe3da251-e829-41d2-9dce-ab560b114834\") " pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:33.474226 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.474195 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2pcdn\" (UniqueName: \"kubernetes.io/projected/fe3da251-e829-41d2-9dce-ab560b114834-kube-api-access-2pcdn\") pod \"kuadrant-operator-catalog-mggsr\" (UID: \"fe3da251-e829-41d2-9dce-ab560b114834\") " pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:33.481697 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.481672 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pcdn\" (UniqueName: \"kubernetes.io/projected/fe3da251-e829-41d2-9dce-ab560b114834-kube-api-access-2pcdn\") pod \"kuadrant-operator-catalog-mggsr\" (UID: \"fe3da251-e829-41d2-9dce-ab560b114834\") " pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:33.609639 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.609567 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" event={"ID":"173c6270-e677-4786-b19e-20ac1e758702","Type":"ContainerStarted","Data":"49b179152c2d5ae807b5af61fd32090dfc5c9953e9cd46752e0c344a3b3dc09a"} Jun 02 01:30:33.626779 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.626751 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:33.758359 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:33.758338 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mggsr"] Jun 02 01:30:33.760499 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:30:33.760473 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3da251_e829_41d2_9dce_ab560b114834.slice/crio-4ef0256653a1ae60ce898021e2f9b0b2250596bf20fcd473199349bc8c66e581 WatchSource:0}: Error finding container 4ef0256653a1ae60ce898021e2f9b0b2250596bf20fcd473199349bc8c66e581: Status 404 returned error can't find the container with id 4ef0256653a1ae60ce898021e2f9b0b2250596bf20fcd473199349bc8c66e581 Jun 02 01:30:34.614981 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:34.614950 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" event={"ID":"fe3da251-e829-41d2-9dce-ab560b114834","Type":"ContainerStarted","Data":"4ef0256653a1ae60ce898021e2f9b0b2250596bf20fcd473199349bc8c66e581"} Jun 02 01:30:35.620050 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.619998 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" event={"ID":"173c6270-e677-4786-b19e-20ac1e758702","Type":"ContainerStarted","Data":"635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730"} Jun 02 01:30:35.620515 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.620064 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" podUID="173c6270-e677-4786-b19e-20ac1e758702" containerName="registry-server" containerID="cri-o://635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730" gracePeriod=2 Jun 02 01:30:35.621756 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.621725 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" event={"ID":"fe3da251-e829-41d2-9dce-ab560b114834","Type":"ContainerStarted","Data":"b127eddbeabd2bed96cd8d7c7f3f06b12c87336a1369e48afd87943854d417ae"} Jun 02 01:30:35.636562 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.636507 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" podStartSLOduration=1.389151431 podStartE2EDuration="3.6364945s" podCreationTimestamp="2026-06-02 01:30:32 +0000 UTC" firstStartedPulling="2026-06-02 01:30:33.197904517 +0000 UTC m=+460.892826797" lastFinishedPulling="2026-06-02 01:30:35.445247585 +0000 UTC m=+463.140169866" observedRunningTime="2026-06-02 01:30:35.635034801 +0000 UTC m=+463.329957103" watchObservedRunningTime="2026-06-02 01:30:35.6364945 +0000 UTC m=+463.331416802" Jun 02 01:30:35.653047 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.653004 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" podStartSLOduration=0.967042688 podStartE2EDuration="2.652994371s" podCreationTimestamp="2026-06-02 01:30:33 +0000 UTC" firstStartedPulling="2026-06-02 01:30:33.761937751 +0000 UTC m=+461.456860031" lastFinishedPulling="2026-06-02 01:30:35.44788943 +0000 UTC m=+463.142811714" observedRunningTime="2026-06-02 01:30:35.650855963 +0000 UTC m=+463.345778329" watchObservedRunningTime="2026-06-02 01:30:35.652994371 +0000 UTC m=+463.347916672" Jun 02 01:30:35.863760 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.863736 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vjdv_173c6270-e677-4786-b19e-20ac1e758702/registry-server/0.log" Jun 02 01:30:35.863882 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.863808 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" Jun 02 01:30:35.895066 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.895039 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8c2b\" (UniqueName: \"kubernetes.io/projected/173c6270-e677-4786-b19e-20ac1e758702-kube-api-access-d8c2b\") pod \"173c6270-e677-4786-b19e-20ac1e758702\" (UID: \"173c6270-e677-4786-b19e-20ac1e758702\") " Jun 02 01:30:35.897224 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.897202 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173c6270-e677-4786-b19e-20ac1e758702-kube-api-access-d8c2b" (OuterVolumeSpecName: "kube-api-access-d8c2b") pod "173c6270-e677-4786-b19e-20ac1e758702" (UID: "173c6270-e677-4786-b19e-20ac1e758702"). InnerVolumeSpecName "kube-api-access-d8c2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:30:35.996735 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:35.996660 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8c2b\" (UniqueName: \"kubernetes.io/projected/173c6270-e677-4786-b19e-20ac1e758702-kube-api-access-d8c2b\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:36.626195 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.626170 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-7vjdv_173c6270-e677-4786-b19e-20ac1e758702/registry-server/0.log" Jun 02 01:30:36.626590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.626208 2609 generic.go:358] "Generic (PLEG): container finished" podID="173c6270-e677-4786-b19e-20ac1e758702" containerID="635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730" exitCode=1 Jun 02 01:30:36.626590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.626275 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" Jun 02 01:30:36.626590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.626302 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" event={"ID":"173c6270-e677-4786-b19e-20ac1e758702","Type":"ContainerDied","Data":"635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730"} Jun 02 01:30:36.626590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.626339 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7vjdv" event={"ID":"173c6270-e677-4786-b19e-20ac1e758702","Type":"ContainerDied","Data":"49b179152c2d5ae807b5af61fd32090dfc5c9953e9cd46752e0c344a3b3dc09a"} Jun 02 01:30:36.626590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.626358 2609 scope.go:117] "RemoveContainer" containerID="635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730" Jun 02 01:30:36.642327 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.642309 2609 scope.go:117] "RemoveContainer" containerID="635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730" Jun 02 01:30:36.642619 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:30:36.642595 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730\": container with ID starting with 635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730 not found: ID does not exist" containerID="635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730" Jun 02 01:30:36.642713 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.642623 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730"} err="failed to get container status \"635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730\": rpc error: code = NotFound desc = could not find container \"635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730\": container with ID starting with 635790b72eefb1dc1dbd5075518d1cb83252510b67bf745e4982c160c986c730 not found: ID does not exist" Jun 02 01:30:36.651694 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.651656 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vjdv"] Jun 02 01:30:36.653507 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.653487 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7vjdv"] Jun 02 01:30:36.937297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:36.937268 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="173c6270-e677-4786-b19e-20ac1e758702" path="/var/lib/kubelet/pods/173c6270-e677-4786-b19e-20ac1e758702/volumes" Jun 02 01:30:43.627778 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:43.627734 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:43.627778 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:43.627787 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:43.650182 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:43.650156 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:43.673809 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:43.673784 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mggsr" Jun 02 01:30:48.521040 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.521009 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6"] Jun 02 01:30:48.521399 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.521381 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173c6270-e677-4786-b19e-20ac1e758702" containerName="registry-server" Jun 02 01:30:48.521399 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.521391 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="173c6270-e677-4786-b19e-20ac1e758702" containerName="registry-server" Jun 02 01:30:48.521943 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.521916 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="173c6270-e677-4786-b19e-20ac1e758702" containerName="registry-server" Jun 02 01:30:48.528760 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.528733 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.531110 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.531087 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gvlrz\"" Jun 02 01:30:48.531244 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.531089 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6"] Jun 02 01:30:48.599432 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.599410 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.599614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.599448 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hrx4\" (UniqueName: \"kubernetes.io/projected/e9d800de-a142-4026-be95-d3afa173cb37-kube-api-access-8hrx4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.599614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.599570 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.700182 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.700156 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.700303 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.700240 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.700303 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.700271 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hrx4\" (UniqueName: \"kubernetes.io/projected/e9d800de-a142-4026-be95-d3afa173cb37-kube-api-access-8hrx4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.700618 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.700602 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.700674 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.700608 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.708714 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.708697 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hrx4\" (UniqueName: \"kubernetes.io/projected/e9d800de-a142-4026-be95-d3afa173cb37-kube-api-access-8hrx4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.840407 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.840352 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:48.969921 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:48.969890 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6"] Jun 02 01:30:48.971595 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:30:48.971558 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d800de_a142_4026_be95_d3afa173cb37.slice/crio-ebd43b87b1b7bd6fb9a4a21b450e7e1a4a6ce607472877c763461a1ab41d1bf4 WatchSource:0}: Error finding container ebd43b87b1b7bd6fb9a4a21b450e7e1a4a6ce607472877c763461a1ab41d1bf4: Status 404 returned error can't find the container with id ebd43b87b1b7bd6fb9a4a21b450e7e1a4a6ce607472877c763461a1ab41d1bf4 Jun 02 01:30:49.116221 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.116153 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c"] Jun 02 01:30:49.119739 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.119719 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.125919 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.125898 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c"] Jun 02 01:30:49.205163 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.205140 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.205258 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.205195 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smkq\" (UniqueName: \"kubernetes.io/projected/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-kube-api-access-8smkq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.205258 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.205252 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.306206 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.306181 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.306316 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.306228 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8smkq\" (UniqueName: \"kubernetes.io/projected/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-kube-api-access-8smkq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.306438 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.306424 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.306598 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.306573 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.306698 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.306685 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.315140 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.315117 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smkq\" (UniqueName: \"kubernetes.io/projected/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-kube-api-access-8smkq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.465314 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.465284 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:49.600049 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.600025 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c"] Jun 02 01:30:49.601927 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:30:49.601896 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e0303c_2ec1_4ea0_8145_8b6e2b2a276d.slice/crio-7ce17613ddbfa174ace848cde103702d345c419ebd79f022adc716ba4fede085 WatchSource:0}: Error finding container 7ce17613ddbfa174ace848cde103702d345c419ebd79f022adc716ba4fede085: Status 404 returned error can't find the container with id 7ce17613ddbfa174ace848cde103702d345c419ebd79f022adc716ba4fede085 Jun 02 01:30:49.675314 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.675290 2609 generic.go:358] "Generic (PLEG): container finished" podID="e9d800de-a142-4026-be95-d3afa173cb37" containerID="397437c5a55823e7f84c3a4edcfecebc311c1d8de44bd1143ade5ec0fdf978c9" exitCode=0 Jun 02 01:30:49.675427 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.675371 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" event={"ID":"e9d800de-a142-4026-be95-d3afa173cb37","Type":"ContainerDied","Data":"397437c5a55823e7f84c3a4edcfecebc311c1d8de44bd1143ade5ec0fdf978c9"} Jun 02 01:30:49.675427 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.675397 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" event={"ID":"e9d800de-a142-4026-be95-d3afa173cb37","Type":"ContainerStarted","Data":"ebd43b87b1b7bd6fb9a4a21b450e7e1a4a6ce607472877c763461a1ab41d1bf4"} Jun 02 01:30:49.676909 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.676880 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" event={"ID":"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d","Type":"ContainerStarted","Data":"9a8a205d2fbc708966493d1818875a701a873e1dd328edb3b7adc2adc1614822"} Jun 02 01:30:49.677002 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.676920 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" event={"ID":"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d","Type":"ContainerStarted","Data":"7ce17613ddbfa174ace848cde103702d345c419ebd79f022adc716ba4fede085"} Jun 02 01:30:49.720480 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.720429 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw"] Jun 02 01:30:49.723899 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.723884 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.731124 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.731103 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw"] Jun 02 01:30:49.810760 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.810735 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.810892 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.810821 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.810965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.810891 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qk5m\" (UniqueName: \"kubernetes.io/projected/cacdd264-db08-4fdf-ba33-3c29da02dd2a-kube-api-access-9qk5m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.911459 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.911430 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.911627 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.911489 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qk5m\" (UniqueName: \"kubernetes.io/projected/cacdd264-db08-4fdf-ba33-3c29da02dd2a-kube-api-access-9qk5m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.911627 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.911516 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.911826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.911804 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.911826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.911820 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:49.920189 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:49.920161 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qk5m\" (UniqueName: \"kubernetes.io/projected/cacdd264-db08-4fdf-ba33-3c29da02dd2a-kube-api-access-9qk5m\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:50.093577 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.093496 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:50.123511 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.123482 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7"] Jun 02 01:30:50.129305 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.129119 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.132709 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.132680 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7"] Jun 02 01:30:50.213315 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.213288 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4brqp\" (UniqueName: \"kubernetes.io/projected/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-kube-api-access-4brqp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.213437 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.213330 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.213437 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.213362 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.235127 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.231154 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw"] Jun 02 01:30:50.314774 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.314745 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4brqp\" (UniqueName: \"kubernetes.io/projected/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-kube-api-access-4brqp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.314922 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.314786 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.314922 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.314811 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.315303 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.315282 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.315353 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.315327 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.324098 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.324066 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4brqp\" (UniqueName: \"kubernetes.io/projected/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-kube-api-access-4brqp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.441043 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.441014 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:50.596002 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.595950 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7"] Jun 02 01:30:50.597343 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:30:50.597316 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f54f8d_e376_40ab_9410_dd2ad6ab49b0.slice/crio-32994adf198f1748df27363e8eb279b1558ee07ab7f4df3bcf6b3fe376c3dd3a WatchSource:0}: Error finding container 32994adf198f1748df27363e8eb279b1558ee07ab7f4df3bcf6b3fe376c3dd3a: Status 404 returned error can't find the container with id 32994adf198f1748df27363e8eb279b1558ee07ab7f4df3bcf6b3fe376c3dd3a Jun 02 01:30:50.682048 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.682012 2609 generic.go:358] "Generic (PLEG): container finished" podID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerID="0775d49b22dbc55f55416d1d943e7ad070fb93e3aa4bb05ac48817e19ec6831e" exitCode=0 Jun 02 01:30:50.682373 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.682113 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" event={"ID":"cacdd264-db08-4fdf-ba33-3c29da02dd2a","Type":"ContainerDied","Data":"0775d49b22dbc55f55416d1d943e7ad070fb93e3aa4bb05ac48817e19ec6831e"} Jun 02 01:30:50.682373 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.682159 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" event={"ID":"cacdd264-db08-4fdf-ba33-3c29da02dd2a","Type":"ContainerStarted","Data":"c0b50bfec29f460e1e929e6e590eb95a54ec775742097757a7dc8a50cdb4e48f"} Jun 02 01:30:50.684619 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.684598 2609 generic.go:358] "Generic (PLEG): container finished" podID="e9d800de-a142-4026-be95-d3afa173cb37" containerID="ded50d2016fe23c934a9d0a51afd5eb1368a0a542a9477c6b7d7c52e574f9e10" exitCode=0 Jun 02 01:30:50.684715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.684688 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" event={"ID":"e9d800de-a142-4026-be95-d3afa173cb37","Type":"ContainerDied","Data":"ded50d2016fe23c934a9d0a51afd5eb1368a0a542a9477c6b7d7c52e574f9e10"} Jun 02 01:30:50.686272 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.686253 2609 generic.go:358] "Generic (PLEG): container finished" podID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerID="9a8a205d2fbc708966493d1818875a701a873e1dd328edb3b7adc2adc1614822" exitCode=0 Jun 02 01:30:50.686338 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.686314 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" event={"ID":"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d","Type":"ContainerDied","Data":"9a8a205d2fbc708966493d1818875a701a873e1dd328edb3b7adc2adc1614822"} Jun 02 01:30:50.687555 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:50.687514 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" event={"ID":"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0","Type":"ContainerStarted","Data":"32994adf198f1748df27363e8eb279b1558ee07ab7f4df3bcf6b3fe376c3dd3a"} Jun 02 01:30:51.693504 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.693475 2609 generic.go:358] "Generic (PLEG): container finished" podID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerID="f488c5618cd5310721c4fd1669c154b68614bdbfcb11193f1d3467862ad9a882" exitCode=0 Jun 02 01:30:51.693838 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.693557 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" event={"ID":"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d","Type":"ContainerDied","Data":"f488c5618cd5310721c4fd1669c154b68614bdbfcb11193f1d3467862ad9a882"} Jun 02 01:30:51.694986 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.694965 2609 generic.go:358] "Generic (PLEG): container finished" podID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerID="9f569eb33e46f4435ec5791f366ffc6e61135c61b9e5dd0f74770411ac482e62" exitCode=0 Jun 02 01:30:51.695088 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.695041 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" event={"ID":"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0","Type":"ContainerDied","Data":"9f569eb33e46f4435ec5791f366ffc6e61135c61b9e5dd0f74770411ac482e62"} Jun 02 01:30:51.696951 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.696931 2609 generic.go:358] "Generic (PLEG): container finished" podID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerID="5de1d8664f2a8d34df17963dfa1ff5bddd0bcc232edf1975790e6491ad7152fa" exitCode=0 Jun 02 01:30:51.697050 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.696983 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" event={"ID":"cacdd264-db08-4fdf-ba33-3c29da02dd2a","Type":"ContainerDied","Data":"5de1d8664f2a8d34df17963dfa1ff5bddd0bcc232edf1975790e6491ad7152fa"} Jun 02 01:30:51.699119 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.699102 2609 generic.go:358] "Generic (PLEG): container finished" podID="e9d800de-a142-4026-be95-d3afa173cb37" containerID="6a57da661a25538a327be213ad89efb013b6d4b37bb6666e7570976953057b52" exitCode=0 Jun 02 01:30:51.699189 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:51.699128 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" event={"ID":"e9d800de-a142-4026-be95-d3afa173cb37","Type":"ContainerDied","Data":"6a57da661a25538a327be213ad89efb013b6d4b37bb6666e7570976953057b52"} Jun 02 01:30:52.705208 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:52.705178 2609 generic.go:358] "Generic (PLEG): container finished" podID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerID="4fca81dacb82c4f4be10d704031b736db6cbe5ffe35791726704e09dcc5d1f14" exitCode=0 Jun 02 01:30:52.705654 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:52.705260 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" event={"ID":"cacdd264-db08-4fdf-ba33-3c29da02dd2a","Type":"ContainerDied","Data":"4fca81dacb82c4f4be10d704031b736db6cbe5ffe35791726704e09dcc5d1f14"} Jun 02 01:30:52.707040 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:52.707016 2609 generic.go:358] "Generic (PLEG): container finished" podID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerID="cf42a77010c9cedc1cda01e002da17e6b401a2417c420a226417976d08c6e8c0" exitCode=0 Jun 02 01:30:52.707136 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:52.707083 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" event={"ID":"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d","Type":"ContainerDied","Data":"cf42a77010c9cedc1cda01e002da17e6b401a2417c420a226417976d08c6e8c0"} Jun 02 01:30:52.708592 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:52.708573 2609 generic.go:358] "Generic (PLEG): container finished" podID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerID="2054700538fee7d871d8ed39e14f33a850c3511bb777a21b0a662f4db3c41720" exitCode=0 Jun 02 01:30:52.708673 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:52.708656 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" event={"ID":"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0","Type":"ContainerDied","Data":"2054700538fee7d871d8ed39e14f33a850c3511bb777a21b0a662f4db3c41720"} Jun 02 01:30:52.919287 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:52.919247 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:53.039662 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.039594 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-util\") pod \"e9d800de-a142-4026-be95-d3afa173cb37\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " Jun 02 01:30:53.039662 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.039622 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-bundle\") pod \"e9d800de-a142-4026-be95-d3afa173cb37\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " Jun 02 01:30:53.039662 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.039649 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hrx4\" (UniqueName: \"kubernetes.io/projected/e9d800de-a142-4026-be95-d3afa173cb37-kube-api-access-8hrx4\") pod \"e9d800de-a142-4026-be95-d3afa173cb37\" (UID: \"e9d800de-a142-4026-be95-d3afa173cb37\") " Jun 02 01:30:53.040071 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.040049 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-bundle" (OuterVolumeSpecName: "bundle") pod "e9d800de-a142-4026-be95-d3afa173cb37" (UID: "e9d800de-a142-4026-be95-d3afa173cb37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:53.041875 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.041850 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9d800de-a142-4026-be95-d3afa173cb37-kube-api-access-8hrx4" (OuterVolumeSpecName: "kube-api-access-8hrx4") pod "e9d800de-a142-4026-be95-d3afa173cb37" (UID: "e9d800de-a142-4026-be95-d3afa173cb37"). InnerVolumeSpecName "kube-api-access-8hrx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:30:53.047687 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.047658 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-util" (OuterVolumeSpecName: "util") pod "e9d800de-a142-4026-be95-d3afa173cb37" (UID: "e9d800de-a142-4026-be95-d3afa173cb37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:53.140845 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.140817 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:53.140930 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.140863 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9d800de-a142-4026-be95-d3afa173cb37-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:53.140930 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.140874 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hrx4\" (UniqueName: \"kubernetes.io/projected/e9d800de-a142-4026-be95-d3afa173cb37-kube-api-access-8hrx4\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:53.713535 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.713491 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" event={"ID":"e9d800de-a142-4026-be95-d3afa173cb37","Type":"ContainerDied","Data":"ebd43b87b1b7bd6fb9a4a21b450e7e1a4a6ce607472877c763461a1ab41d1bf4"} Jun 02 01:30:53.713535 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.713496 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6" Jun 02 01:30:53.713967 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.713545 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebd43b87b1b7bd6fb9a4a21b450e7e1a4a6ce607472877c763461a1ab41d1bf4" Jun 02 01:30:53.715454 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.715426 2609 generic.go:358] "Generic (PLEG): container finished" podID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerID="b986f2060f610c23cc56cf5b18c686a08caa835528bf7c9fdd3fadbd39504082" exitCode=0 Jun 02 01:30:53.715613 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.715555 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" event={"ID":"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0","Type":"ContainerDied","Data":"b986f2060f610c23cc56cf5b18c686a08caa835528bf7c9fdd3fadbd39504082"} Jun 02 01:30:53.846015 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.845992 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:53.880558 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.880514 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:53.948147 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948117 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-util\") pod \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " Jun 02 01:30:53.948290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948157 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-bundle\") pod \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " Jun 02 01:30:53.948290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948178 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-bundle\") pod \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " Jun 02 01:30:53.948290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948206 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-util\") pod \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " Jun 02 01:30:53.948290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948224 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8smkq\" (UniqueName: \"kubernetes.io/projected/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-kube-api-access-8smkq\") pod \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\" (UID: \"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d\") " Jun 02 01:30:53.948290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948273 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qk5m\" (UniqueName: \"kubernetes.io/projected/cacdd264-db08-4fdf-ba33-3c29da02dd2a-kube-api-access-9qk5m\") pod \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\" (UID: \"cacdd264-db08-4fdf-ba33-3c29da02dd2a\") " Jun 02 01:30:53.948938 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948799 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-bundle" (OuterVolumeSpecName: "bundle") pod "81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" (UID: "81e0303c-2ec1-4ea0-8145-8b6e2b2a276d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:53.948938 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.948902 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-bundle" (OuterVolumeSpecName: "bundle") pod "cacdd264-db08-4fdf-ba33-3c29da02dd2a" (UID: "cacdd264-db08-4fdf-ba33-3c29da02dd2a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:53.950514 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.950481 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-kube-api-access-8smkq" (OuterVolumeSpecName: "kube-api-access-8smkq") pod "81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" (UID: "81e0303c-2ec1-4ea0-8145-8b6e2b2a276d"). InnerVolumeSpecName "kube-api-access-8smkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:30:53.950611 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.950556 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cacdd264-db08-4fdf-ba33-3c29da02dd2a-kube-api-access-9qk5m" (OuterVolumeSpecName: "kube-api-access-9qk5m") pod "cacdd264-db08-4fdf-ba33-3c29da02dd2a" (UID: "cacdd264-db08-4fdf-ba33-3c29da02dd2a"). InnerVolumeSpecName "kube-api-access-9qk5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:30:53.954074 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.954053 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-util" (OuterVolumeSpecName: "util") pod "cacdd264-db08-4fdf-ba33-3c29da02dd2a" (UID: "cacdd264-db08-4fdf-ba33-3c29da02dd2a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:53.954350 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:53.954331 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-util" (OuterVolumeSpecName: "util") pod "81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" (UID: "81e0303c-2ec1-4ea0-8145-8b6e2b2a276d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:54.049052 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.048984 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:54.049052 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.049016 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8smkq\" (UniqueName: \"kubernetes.io/projected/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-kube-api-access-8smkq\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:54.049052 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.049027 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qk5m\" (UniqueName: \"kubernetes.io/projected/cacdd264-db08-4fdf-ba33-3c29da02dd2a-kube-api-access-9qk5m\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:54.049052 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.049036 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:54.049052 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.049045 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cacdd264-db08-4fdf-ba33-3c29da02dd2a-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:54.049052 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.049054 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e0303c-2ec1-4ea0-8145-8b6e2b2a276d-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:54.721206 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.721178 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" Jun 02 01:30:54.721206 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.721185 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw" event={"ID":"cacdd264-db08-4fdf-ba33-3c29da02dd2a","Type":"ContainerDied","Data":"c0b50bfec29f460e1e929e6e590eb95a54ec775742097757a7dc8a50cdb4e48f"} Jun 02 01:30:54.721770 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.721221 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0b50bfec29f460e1e929e6e590eb95a54ec775742097757a7dc8a50cdb4e48f" Jun 02 01:30:54.723091 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.723073 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" Jun 02 01:30:54.723175 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.723098 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c" event={"ID":"81e0303c-2ec1-4ea0-8145-8b6e2b2a276d","Type":"ContainerDied","Data":"7ce17613ddbfa174ace848cde103702d345c419ebd79f022adc716ba4fede085"} Jun 02 01:30:54.723175 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.723121 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ce17613ddbfa174ace848cde103702d345c419ebd79f022adc716ba4fede085" Jun 02 01:30:54.845096 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.845076 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:30:54.957154 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.957130 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4brqp\" (UniqueName: \"kubernetes.io/projected/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-kube-api-access-4brqp\") pod \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " Jun 02 01:30:54.957299 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.957181 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-bundle\") pod \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " Jun 02 01:30:54.957299 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.957210 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-util\") pod \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\" (UID: \"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0\") " Jun 02 01:30:54.957693 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.957661 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-bundle" (OuterVolumeSpecName: "bundle") pod "b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" (UID: "b2f54f8d-e376-40ab-9410-dd2ad6ab49b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:54.959344 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.959310 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-kube-api-access-4brqp" (OuterVolumeSpecName: "kube-api-access-4brqp") pod "b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" (UID: "b2f54f8d-e376-40ab-9410-dd2ad6ab49b0"). InnerVolumeSpecName "kube-api-access-4brqp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:30:54.962798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:54.962777 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-util" (OuterVolumeSpecName: "util") pod "b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" (UID: "b2f54f8d-e376-40ab-9410-dd2ad6ab49b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:30:55.058397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:55.058336 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:55.058397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:55.058360 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:55.058397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:55.058373 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4brqp\" (UniqueName: \"kubernetes.io/projected/b2f54f8d-e376-40ab-9410-dd2ad6ab49b0-kube-api-access-4brqp\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:30:55.729058 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:55.729016 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" event={"ID":"b2f54f8d-e376-40ab-9410-dd2ad6ab49b0","Type":"ContainerDied","Data":"32994adf198f1748df27363e8eb279b1558ee07ab7f4df3bcf6b3fe376c3dd3a"} Jun 02 01:30:55.729058 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:55.729060 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32994adf198f1748df27363e8eb279b1558ee07ab7f4df3bcf6b3fe376c3dd3a" Jun 02 01:30:55.729608 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:30:55.729035 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7" Jun 02 01:31:04.825723 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.825693 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj"] Jun 02 01:31:04.826094 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826081 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d800de-a142-4026-be95-d3afa173cb37" containerName="pull" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826097 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d800de-a142-4026-be95-d3afa173cb37" containerName="pull" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826105 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerName="pull" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826110 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerName="pull" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826120 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerName="util" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826126 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerName="util" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826132 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerName="extract" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826138 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerName="extract" Jun 02 01:31:04.826143 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826144 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826149 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826156 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826161 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826169 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d800de-a142-4026-be95-d3afa173cb37" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826174 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d800de-a142-4026-be95-d3afa173cb37" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826180 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerName="util" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826186 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerName="util" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826197 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9d800de-a142-4026-be95-d3afa173cb37" containerName="util" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826202 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9d800de-a142-4026-be95-d3afa173cb37" containerName="util" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826208 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerName="util" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826213 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerName="util" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826218 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerName="pull" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826223 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerName="pull" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826234 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerName="pull" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826239 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerName="pull" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826294 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="b2f54f8d-e376-40ab-9410-dd2ad6ab49b0" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826303 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="e9d800de-a142-4026-be95-d3afa173cb37" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826311 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="cacdd264-db08-4fdf-ba33-3c29da02dd2a" containerName="extract" Jun 02 01:31:04.826382 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.826318 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="81e0303c-2ec1-4ea0-8145-8b6e2b2a276d" containerName="extract" Jun 02 01:31:04.841824 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.841802 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:04.844250 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.844231 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xzs4k\"" Jun 02 01:31:04.846023 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.845998 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj"] Jun 02 01:31:04.939178 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:04.939151 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfsvc\" (UniqueName: \"kubernetes.io/projected/58f9fdb1-257b-48af-9ed9-065d8df0e445-kube-api-access-vfsvc\") pod \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" (UID: \"58f9fdb1-257b-48af-9ed9-065d8df0e445\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:05.040619 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:05.040590 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfsvc\" (UniqueName: \"kubernetes.io/projected/58f9fdb1-257b-48af-9ed9-065d8df0e445-kube-api-access-vfsvc\") pod \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" (UID: \"58f9fdb1-257b-48af-9ed9-065d8df0e445\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:05.049424 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:05.049400 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfsvc\" (UniqueName: \"kubernetes.io/projected/58f9fdb1-257b-48af-9ed9-065d8df0e445-kube-api-access-vfsvc\") pod \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" (UID: \"58f9fdb1-257b-48af-9ed9-065d8df0e445\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:05.153911 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:05.153851 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:05.290845 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:05.290817 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj"] Jun 02 01:31:05.292862 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:31:05.292834 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f9fdb1_257b_48af_9ed9_065d8df0e445.slice/crio-7e16063a594b848a377fa6ddc5ec67eefe3ef4aa2d73a8e1337247f7d26b094d WatchSource:0}: Error finding container 7e16063a594b848a377fa6ddc5ec67eefe3ef4aa2d73a8e1337247f7d26b094d: Status 404 returned error can't find the container with id 7e16063a594b848a377fa6ddc5ec67eefe3ef4aa2d73a8e1337247f7d26b094d Jun 02 01:31:05.769025 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:05.768991 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" event={"ID":"58f9fdb1-257b-48af-9ed9-065d8df0e445","Type":"ContainerStarted","Data":"7e16063a594b848a377fa6ddc5ec67eefe3ef4aa2d73a8e1337247f7d26b094d"} Jun 02 01:31:07.780092 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:07.780052 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" event={"ID":"58f9fdb1-257b-48af-9ed9-065d8df0e445","Type":"ContainerStarted","Data":"8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1"} Jun 02 01:31:07.780476 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:07.780225 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:07.796829 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:07.796780 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" podStartSLOduration=2.019870846 podStartE2EDuration="3.796767737s" podCreationTimestamp="2026-06-02 01:31:04 +0000 UTC" firstStartedPulling="2026-06-02 01:31:05.29482307 +0000 UTC m=+492.989745358" lastFinishedPulling="2026-06-02 01:31:07.071719969 +0000 UTC m=+494.766642249" observedRunningTime="2026-06-02 01:31:07.794800096 +0000 UTC m=+495.489722397" watchObservedRunningTime="2026-06-02 01:31:07.796767737 +0000 UTC m=+495.491690038" Jun 02 01:31:12.857267 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:12.857232 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg"] Jun 02 01:31:12.865107 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:12.865091 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" Jun 02 01:31:12.867853 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:12.867832 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sr64h\"" Jun 02 01:31:12.868064 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:12.868051 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 01:31:12.878616 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:12.878595 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg"] Jun 02 01:31:13.009730 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:13.009696 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln67q\" (UniqueName: \"kubernetes.io/projected/ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa-kube-api-access-ln67q\") pod \"dns-operator-controller-manager-648d5c98bc-258fg\" (UID: \"ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" Jun 02 01:31:13.110750 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:13.110665 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ln67q\" (UniqueName: \"kubernetes.io/projected/ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa-kube-api-access-ln67q\") pod \"dns-operator-controller-manager-648d5c98bc-258fg\" (UID: \"ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" Jun 02 01:31:13.133452 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:13.133426 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln67q\" (UniqueName: \"kubernetes.io/projected/ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa-kube-api-access-ln67q\") pod \"dns-operator-controller-manager-648d5c98bc-258fg\" (UID: \"ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" Jun 02 01:31:13.175395 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:13.175375 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" Jun 02 01:31:13.313155 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:13.313131 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg"] Jun 02 01:31:13.315589 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:31:13.315564 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3ec1bf_ee21_4f0e_bfdf_93c1983793aa.slice/crio-8fb2bd622699210343ed680cc86fb271d3a01630f014d1416c632c59e3f9286d WatchSource:0}: Error finding container 8fb2bd622699210343ed680cc86fb271d3a01630f014d1416c632c59e3f9286d: Status 404 returned error can't find the container with id 8fb2bd622699210343ed680cc86fb271d3a01630f014d1416c632c59e3f9286d Jun 02 01:31:13.803331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:13.803288 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" event={"ID":"ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa","Type":"ContainerStarted","Data":"8fb2bd622699210343ed680cc86fb271d3a01630f014d1416c632c59e3f9286d"} Jun 02 01:31:15.812318 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:15.812286 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" event={"ID":"ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa","Type":"ContainerStarted","Data":"6787c271c6d072a9e7d698377ed4811432a0bc05942027ac5008d5bc06e24195"} Jun 02 01:31:15.812739 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:15.812512 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" Jun 02 01:31:15.837071 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:15.837015 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" podStartSLOduration=1.512773593 podStartE2EDuration="3.836995763s" podCreationTimestamp="2026-06-02 01:31:12 +0000 UTC" firstStartedPulling="2026-06-02 01:31:13.317842587 +0000 UTC m=+501.012764870" lastFinishedPulling="2026-06-02 01:31:15.642064755 +0000 UTC m=+503.336987040" observedRunningTime="2026-06-02 01:31:15.835383232 +0000 UTC m=+503.530305539" watchObservedRunningTime="2026-06-02 01:31:15.836995763 +0000 UTC m=+503.531918065" Jun 02 01:31:16.737843 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:16.737812 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-lnhr5"] Jun 02 01:31:16.741461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:16.741444 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" Jun 02 01:31:16.744004 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:16.743982 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ccjfg\"" Jun 02 01:31:16.755305 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:16.755284 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-lnhr5"] Jun 02 01:31:16.841825 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:16.841795 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwzpg\" (UniqueName: \"kubernetes.io/projected/faeb1c35-8360-478e-81c5-6e5e7d5d2a69-kube-api-access-fwzpg\") pod \"authorino-operator-657f44b778-lnhr5\" (UID: \"faeb1c35-8360-478e-81c5-6e5e7d5d2a69\") " pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" Jun 02 01:31:16.942368 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:16.942337 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwzpg\" (UniqueName: \"kubernetes.io/projected/faeb1c35-8360-478e-81c5-6e5e7d5d2a69-kube-api-access-fwzpg\") pod \"authorino-operator-657f44b778-lnhr5\" (UID: \"faeb1c35-8360-478e-81c5-6e5e7d5d2a69\") " pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" Jun 02 01:31:16.955464 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:16.955436 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwzpg\" (UniqueName: \"kubernetes.io/projected/faeb1c35-8360-478e-81c5-6e5e7d5d2a69-kube-api-access-fwzpg\") pod \"authorino-operator-657f44b778-lnhr5\" (UID: \"faeb1c35-8360-478e-81c5-6e5e7d5d2a69\") " pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" Jun 02 01:31:17.051241 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:17.051173 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" Jun 02 01:31:17.184503 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:17.184470 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-lnhr5"] Jun 02 01:31:17.185470 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:31:17.185446 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaeb1c35_8360_478e_81c5_6e5e7d5d2a69.slice/crio-e3f8aa31bc162275ea290836218a2adbbb0dd2cbbdbc3e3535588b01afcdec0b WatchSource:0}: Error finding container e3f8aa31bc162275ea290836218a2adbbb0dd2cbbdbc3e3535588b01afcdec0b: Status 404 returned error can't find the container with id e3f8aa31bc162275ea290836218a2adbbb0dd2cbbdbc3e3535588b01afcdec0b Jun 02 01:31:17.822324 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:17.822278 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" event={"ID":"faeb1c35-8360-478e-81c5-6e5e7d5d2a69","Type":"ContainerStarted","Data":"e3f8aa31bc162275ea290836218a2adbbb0dd2cbbdbc3e3535588b01afcdec0b"} Jun 02 01:31:18.786419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:18.786390 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:19.832891 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:19.832860 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" event={"ID":"faeb1c35-8360-478e-81c5-6e5e7d5d2a69","Type":"ContainerStarted","Data":"576fd68201c661e514c522e4f9c85763a5413f89390103291ceb2a8176bf1256"} Jun 02 01:31:19.833227 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:19.832984 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" Jun 02 01:31:19.878536 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:19.878480 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" podStartSLOduration=1.427459626 podStartE2EDuration="3.878466614s" podCreationTimestamp="2026-06-02 01:31:16 +0000 UTC" firstStartedPulling="2026-06-02 01:31:17.187418896 +0000 UTC m=+504.882341176" lastFinishedPulling="2026-06-02 01:31:19.638425885 +0000 UTC m=+507.333348164" observedRunningTime="2026-06-02 01:31:19.874697458 +0000 UTC m=+507.569619785" watchObservedRunningTime="2026-06-02 01:31:19.878466614 +0000 UTC m=+507.573388916" Jun 02 01:31:26.819095 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:26.819064 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-258fg" Jun 02 01:31:28.870650 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:28.870613 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn"] Jun 02 01:31:28.875788 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:28.875766 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:28.879856 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:28.879838 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s45vr\"" Jun 02 01:31:28.887326 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:28.887304 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn"] Jun 02 01:31:28.953246 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:28.953216 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfzt5\" (UniqueName: \"kubernetes.io/projected/46cd699c-c4ec-4515-ac15-e4fd579f20a7-kube-api-access-tfzt5\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:28.953387 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:28.953352 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46cd699c-c4ec-4515-ac15-e4fd579f20a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:29.054816 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.054785 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46cd699c-c4ec-4515-ac15-e4fd579f20a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:29.054974 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.054888 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfzt5\" (UniqueName: \"kubernetes.io/projected/46cd699c-c4ec-4515-ac15-e4fd579f20a7-kube-api-access-tfzt5\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:29.055189 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.055167 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46cd699c-c4ec-4515-ac15-e4fd579f20a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:29.064110 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.064089 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfzt5\" (UniqueName: \"kubernetes.io/projected/46cd699c-c4ec-4515-ac15-e4fd579f20a7-kube-api-access-tfzt5\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:29.186474 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.186452 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:29.318977 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.318951 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn"] Jun 02 01:31:29.320850 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:31:29.320826 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46cd699c_c4ec_4515_ac15_e4fd579f20a7.slice/crio-778425a372ba830d4e16b83fae249c708961cb24058554b689fa5b921fcd27bb WatchSource:0}: Error finding container 778425a372ba830d4e16b83fae249c708961cb24058554b689fa5b921fcd27bb: Status 404 returned error can't find the container with id 778425a372ba830d4e16b83fae249c708961cb24058554b689fa5b921fcd27bb Jun 02 01:31:29.507584 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.507494 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn"] Jun 02 01:31:29.513562 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.513515 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn"] Jun 02 01:31:29.527852 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.527821 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj"] Jun 02 01:31:29.528082 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.528056 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" containerName="manager" containerID="cri-o://8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1" gracePeriod=2 Jun 02 01:31:29.539869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.539781 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn"] Jun 02 01:31:29.543979 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.543956 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj"] Jun 02 01:31:29.544103 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.544086 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.546488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.546460 2609 status_manager.go:895] "Failed to get status for pod" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:29.564304 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.564270 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17a05bd0-6937-441b-87a3-ce39c91ed6b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-52zwn\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.564493 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.564472 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76t69\" (UniqueName: \"kubernetes.io/projected/17a05bd0-6937-441b-87a3-ce39c91ed6b5-kube-api-access-76t69\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-52zwn\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.571091 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.571069 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn"] Jun 02 01:31:29.573293 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.573273 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw"] Jun 02 01:31:29.573644 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.573631 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" containerName="manager" Jun 02 01:31:29.573690 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.573646 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" containerName="manager" Jun 02 01:31:29.573725 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.573720 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" containerName="manager" Jun 02 01:31:29.576626 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.576609 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" Jun 02 01:31:29.591590 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.591570 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw"] Jun 02 01:31:29.614819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.614785 2609 status_manager.go:895] "Failed to get status for pod" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:29.665938 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.665913 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76t69\" (UniqueName: \"kubernetes.io/projected/17a05bd0-6937-441b-87a3-ce39c91ed6b5-kube-api-access-76t69\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-52zwn\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.666092 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.665960 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17a05bd0-6937-441b-87a3-ce39c91ed6b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-52zwn\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.666092 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.665988 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8ljx\" (UniqueName: \"kubernetes.io/projected/ca0d1790-d9a5-47ad-9efb-bb3841d49b09-kube-api-access-b8ljx\") pod \"limitador-operator-controller-manager-85c4996f8c-wqngw\" (UID: \"ca0d1790-d9a5-47ad-9efb-bb3841d49b09\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" Jun 02 01:31:29.666280 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.666261 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17a05bd0-6937-441b-87a3-ce39c91ed6b5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-52zwn\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.679075 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.679050 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76t69\" (UniqueName: \"kubernetes.io/projected/17a05bd0-6937-441b-87a3-ce39c91ed6b5-kube-api-access-76t69\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-52zwn\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.751918 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.751897 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:29.753998 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.753975 2609 status_manager.go:895] "Failed to get status for pod" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:29.766452 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.766411 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfsvc\" (UniqueName: \"kubernetes.io/projected/58f9fdb1-257b-48af-9ed9-065d8df0e445-kube-api-access-vfsvc\") pod \"58f9fdb1-257b-48af-9ed9-065d8df0e445\" (UID: \"58f9fdb1-257b-48af-9ed9-065d8df0e445\") " Jun 02 01:31:29.766515 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.766483 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8ljx\" (UniqueName: \"kubernetes.io/projected/ca0d1790-d9a5-47ad-9efb-bb3841d49b09-kube-api-access-b8ljx\") pod \"limitador-operator-controller-manager-85c4996f8c-wqngw\" (UID: \"ca0d1790-d9a5-47ad-9efb-bb3841d49b09\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" Jun 02 01:31:29.768394 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.768374 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f9fdb1-257b-48af-9ed9-065d8df0e445-kube-api-access-vfsvc" (OuterVolumeSpecName: "kube-api-access-vfsvc") pod "58f9fdb1-257b-48af-9ed9-065d8df0e445" (UID: "58f9fdb1-257b-48af-9ed9-065d8df0e445"). InnerVolumeSpecName "kube-api-access-vfsvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:31:29.774754 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.774734 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8ljx\" (UniqueName: \"kubernetes.io/projected/ca0d1790-d9a5-47ad-9efb-bb3841d49b09-kube-api-access-b8ljx\") pod \"limitador-operator-controller-manager-85c4996f8c-wqngw\" (UID: \"ca0d1790-d9a5-47ad-9efb-bb3841d49b09\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" Jun 02 01:31:29.867285 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.867258 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfsvc\" (UniqueName: \"kubernetes.io/projected/58f9fdb1-257b-48af-9ed9-065d8df0e445-kube-api-access-vfsvc\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:31:29.874447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.874420 2609 generic.go:358] "Generic (PLEG): container finished" podID="58f9fdb1-257b-48af-9ed9-065d8df0e445" containerID="8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1" exitCode=0 Jun 02 01:31:29.874898 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.874474 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" Jun 02 01:31:29.874898 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.874541 2609 scope.go:117] "RemoveContainer" containerID="8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1" Jun 02 01:31:29.876752 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.876719 2609 status_manager.go:895] "Failed to get status for pod" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:29.885399 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.885380 2609 scope.go:117] "RemoveContainer" containerID="8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1" Jun 02 01:31:29.885716 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:31:29.885697 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1\": container with ID starting with 8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1 not found: ID does not exist" containerID="8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1" Jun 02 01:31:29.885819 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.885721 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1"} err="failed to get container status \"8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1\": rpc error: code = NotFound desc = could not find container \"8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1\": container with ID starting with 8896d5c3b1e74be1665ae8825de926899796852f88f572cb7580cc67c2e133d1 not found: ID does not exist" Jun 02 01:31:29.886541 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.886488 2609 status_manager.go:895] "Failed to get status for pod" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:29.905747 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.905730 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:29.912433 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:29.912412 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" Jun 02 01:31:30.074623 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.074588 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn"] Jun 02 01:31:30.076794 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:31:30.076741 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a05bd0_6937_441b_87a3_ce39c91ed6b5.slice/crio-473db9884f3e725f5559e9723c7f47486cf233bac11314603e8f81838601b797 WatchSource:0}: Error finding container 473db9884f3e725f5559e9723c7f47486cf233bac11314603e8f81838601b797: Status 404 returned error can't find the container with id 473db9884f3e725f5559e9723c7f47486cf233bac11314603e8f81838601b797 Jun 02 01:31:30.108369 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.108340 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw"] Jun 02 01:31:30.109706 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:31:30.109668 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0d1790_d9a5_47ad_9efb_bb3841d49b09.slice/crio-9a1e1bc66d323110dc6f8965a4e00c436ecca04767f2215af002f8064d779bee WatchSource:0}: Error finding container 9a1e1bc66d323110dc6f8965a4e00c436ecca04767f2215af002f8064d779bee: Status 404 returned error can't find the container with id 9a1e1bc66d323110dc6f8965a4e00c436ecca04767f2215af002f8064d779bee Jun 02 01:31:30.839430 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.839399 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-lnhr5" Jun 02 01:31:30.841609 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.841558 2609 status_manager.go:895] "Failed to get status for pod" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:30.884375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.884335 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" event={"ID":"ca0d1790-d9a5-47ad-9efb-bb3841d49b09","Type":"ContainerStarted","Data":"fb3d3e4c92c3dadbf23bc6a3c5376e7ea54c1fe8faaa418dc9312dac1b695669"} Jun 02 01:31:30.884375 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.884378 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" event={"ID":"ca0d1790-d9a5-47ad-9efb-bb3841d49b09","Type":"ContainerStarted","Data":"9a1e1bc66d323110dc6f8965a4e00c436ecca04767f2215af002f8064d779bee"} Jun 02 01:31:30.884930 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.884422 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" Jun 02 01:31:30.886319 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.886286 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" event={"ID":"17a05bd0-6937-441b-87a3-ce39c91ed6b5","Type":"ContainerStarted","Data":"473db9884f3e725f5559e9723c7f47486cf233bac11314603e8f81838601b797"} Jun 02 01:31:30.909088 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.909054 2609 status_manager.go:895] "Failed to get status for pod" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-jjvtj" err="pods \"limitador-operator-controller-manager-85c4996f8c-jjvtj\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:30.910189 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.910150 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" podStartSLOduration=1.9101368079999999 podStartE2EDuration="1.910136808s" podCreationTimestamp="2026-06-02 01:31:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:31:30.906958578 +0000 UTC m=+518.601880881" watchObservedRunningTime="2026-06-02 01:31:30.910136808 +0000 UTC m=+518.605059109" Jun 02 01:31:30.939133 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:30.939105 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f9fdb1-257b-48af-9ed9-065d8df0e445" path="/var/lib/kubelet/pods/58f9fdb1-257b-48af-9ed9-065d8df0e445/volumes" Jun 02 01:31:33.903452 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:33.903404 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" containerName="manager" containerID="cri-o://239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212" gracePeriod=2 Jun 02 01:31:33.905241 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:33.905213 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" event={"ID":"17a05bd0-6937-441b-87a3-ce39c91ed6b5","Type":"ContainerStarted","Data":"bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6"} Jun 02 01:31:33.905393 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:33.905308 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:33.905479 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:33.905455 2609 status_manager.go:895] "Failed to get status for pod" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:33.907197 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:33.907172 2609 status_manager.go:895] "Failed to get status for pod" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:33.927214 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:33.927160 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" podStartSLOduration=1.980969354 podStartE2EDuration="4.927143588s" podCreationTimestamp="2026-06-02 01:31:29 +0000 UTC" firstStartedPulling="2026-06-02 01:31:30.079329502 +0000 UTC m=+517.774251796" lastFinishedPulling="2026-06-02 01:31:33.025503735 +0000 UTC m=+520.720426030" observedRunningTime="2026-06-02 01:31:33.925068959 +0000 UTC m=+521.619991262" watchObservedRunningTime="2026-06-02 01:31:33.927143588 +0000 UTC m=+521.622065892" Jun 02 01:31:34.144094 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.144073 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:34.146387 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.146359 2609 status_manager.go:895] "Failed to get status for pod" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:34.213038 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.213012 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfzt5\" (UniqueName: \"kubernetes.io/projected/46cd699c-c4ec-4515-ac15-e4fd579f20a7-kube-api-access-tfzt5\") pod \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " Jun 02 01:31:34.213155 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.213059 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46cd699c-c4ec-4515-ac15-e4fd579f20a7-extensions-socket-volume\") pod \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\" (UID: \"46cd699c-c4ec-4515-ac15-e4fd579f20a7\") " Jun 02 01:31:34.213321 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.213294 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46cd699c-c4ec-4515-ac15-e4fd579f20a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "46cd699c-c4ec-4515-ac15-e4fd579f20a7" (UID: "46cd699c-c4ec-4515-ac15-e4fd579f20a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:31:34.215138 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.215121 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46cd699c-c4ec-4515-ac15-e4fd579f20a7-kube-api-access-tfzt5" (OuterVolumeSpecName: "kube-api-access-tfzt5") pod "46cd699c-c4ec-4515-ac15-e4fd579f20a7" (UID: "46cd699c-c4ec-4515-ac15-e4fd579f20a7"). InnerVolumeSpecName "kube-api-access-tfzt5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:31:34.314245 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.314222 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfzt5\" (UniqueName: \"kubernetes.io/projected/46cd699c-c4ec-4515-ac15-e4fd579f20a7-kube-api-access-tfzt5\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:31:34.314245 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.314243 2609 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/46cd699c-c4ec-4515-ac15-e4fd579f20a7-extensions-socket-volume\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:31:34.910945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.910907 2609 generic.go:358] "Generic (PLEG): container finished" podID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" containerID="239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212" exitCode=2 Jun 02 01:31:34.911408 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.910980 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" Jun 02 01:31:34.911408 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.910999 2609 scope.go:117] "RemoveContainer" containerID="239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212" Jun 02 01:31:34.913310 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.913274 2609 status_manager.go:895] "Failed to get status for pod" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:34.920447 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.920431 2609 scope.go:117] "RemoveContainer" containerID="239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212" Jun 02 01:31:34.920721 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:31:34.920702 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212\": container with ID starting with 239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212 not found: ID does not exist" containerID="239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212" Jun 02 01:31:34.920799 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.920731 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212"} err="failed to get container status \"239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212\": rpc error: code = NotFound desc = could not find container \"239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212\": container with ID starting with 239f0101b8dd877ba645ab610682d5ed5e002889b7fde24e1ae558c5a5cdc212 not found: ID does not exist" Jun 02 01:31:34.921352 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.921331 2609 status_manager.go:895] "Failed to get status for pod" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-jdfbn\" is forbidden: User \"system:node:ip-10-0-140-112.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-112.ec2.internal' and this object" Jun 02 01:31:34.937301 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:34.937276 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" path="/var/lib/kubelet/pods/46cd699c-c4ec-4515-ac15-e4fd579f20a7/volumes" Jun 02 01:31:41.894712 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:41.894638 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-wqngw" Jun 02 01:31:44.913232 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:44.913201 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:56.107077 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.107033 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b7f4f8cd6-sp6d9"] Jun 02 01:31:56.107635 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.107615 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" containerName="manager" Jun 02 01:31:56.107777 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.107759 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" containerName="manager" Jun 02 01:31:56.108029 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.108011 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="46cd699c-c4ec-4515-ac15-e4fd579f20a7" containerName="manager" Jun 02 01:31:56.113185 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.113164 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.120274 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.120249 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7f4f8cd6-sp6d9"] Jun 02 01:31:56.205025 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.204996 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-service-ca\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.205172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.205042 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d154cc93-3da2-4f1b-a579-06c303e6364d-console-serving-cert\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.205172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.205072 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-oauth-serving-cert\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.205172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.205106 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v597z\" (UniqueName: \"kubernetes.io/projected/d154cc93-3da2-4f1b-a579-06c303e6364d-kube-api-access-v597z\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.205172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.205138 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-console-config\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.205305 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.205201 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d154cc93-3da2-4f1b-a579-06c303e6364d-console-oauth-config\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.205305 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.205229 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-trusted-ca-bundle\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.306604 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.306571 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d154cc93-3da2-4f1b-a579-06c303e6364d-console-serving-cert\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.306604 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.306607 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-oauth-serving-cert\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.306798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.306643 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v597z\" (UniqueName: \"kubernetes.io/projected/d154cc93-3da2-4f1b-a579-06c303e6364d-kube-api-access-v597z\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.306798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.306680 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-console-config\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.306798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.306709 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d154cc93-3da2-4f1b-a579-06c303e6364d-console-oauth-config\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.306798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.306730 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-trusted-ca-bundle\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.307005 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.306804 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-service-ca\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.307459 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.307434 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-oauth-serving-cert\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.307614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.307504 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-service-ca\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.307614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.307583 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-console-config\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.307717 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.307642 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d154cc93-3da2-4f1b-a579-06c303e6364d-trusted-ca-bundle\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.309761 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.309741 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d154cc93-3da2-4f1b-a579-06c303e6364d-console-serving-cert\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.309845 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.309741 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d154cc93-3da2-4f1b-a579-06c303e6364d-console-oauth-config\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.315509 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.315490 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v597z\" (UniqueName: \"kubernetes.io/projected/d154cc93-3da2-4f1b-a579-06c303e6364d-kube-api-access-v597z\") pod \"console-7b7f4f8cd6-sp6d9\" (UID: \"d154cc93-3da2-4f1b-a579-06c303e6364d\") " pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.424893 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.424865 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:31:56.564172 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.564139 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b7f4f8cd6-sp6d9"] Jun 02 01:31:56.565496 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:31:56.565468 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd154cc93_3da2_4f1b_a579_06c303e6364d.slice/crio-d2148e2cf35db9d2d4324a70ba6b38695121e19ae7d1824ee9762bfe9a1e7379 WatchSource:0}: Error finding container d2148e2cf35db9d2d4324a70ba6b38695121e19ae7d1824ee9762bfe9a1e7379: Status 404 returned error can't find the container with id d2148e2cf35db9d2d4324a70ba6b38695121e19ae7d1824ee9762bfe9a1e7379 Jun 02 01:31:56.945832 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.945798 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn"] Jun 02 01:31:56.946083 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:56.946032 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" podUID="17a05bd0-6937-441b-87a3-ce39c91ed6b5" containerName="manager" containerID="cri-o://bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6" gracePeriod=10 Jun 02 01:31:57.000355 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.000318 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7f4f8cd6-sp6d9" event={"ID":"d154cc93-3da2-4f1b-a579-06c303e6364d","Type":"ContainerStarted","Data":"81ccdf819b52f26b10cf4154db4d2df69ef7e28cfa7ffd185af9b353ebc6cef4"} Jun 02 01:31:57.000355 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.000352 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b7f4f8cd6-sp6d9" event={"ID":"d154cc93-3da2-4f1b-a579-06c303e6364d","Type":"ContainerStarted","Data":"d2148e2cf35db9d2d4324a70ba6b38695121e19ae7d1824ee9762bfe9a1e7379"} Jun 02 01:31:57.041169 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.041121 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7b7f4f8cd6-sp6d9" podStartSLOduration=1.041108361 podStartE2EDuration="1.041108361s" podCreationTimestamp="2026-06-02 01:31:56 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:31:57.038208003 +0000 UTC m=+544.733130299" watchObservedRunningTime="2026-06-02 01:31:57.041108361 +0000 UTC m=+544.736030663" Jun 02 01:31:57.172072 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.172050 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:57.314379 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.314294 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17a05bd0-6937-441b-87a3-ce39c91ed6b5-extensions-socket-volume\") pod \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " Jun 02 01:31:57.314379 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.314350 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76t69\" (UniqueName: \"kubernetes.io/projected/17a05bd0-6937-441b-87a3-ce39c91ed6b5-kube-api-access-76t69\") pod \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\" (UID: \"17a05bd0-6937-441b-87a3-ce39c91ed6b5\") " Jun 02 01:31:57.314712 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.314688 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17a05bd0-6937-441b-87a3-ce39c91ed6b5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "17a05bd0-6937-441b-87a3-ce39c91ed6b5" (UID: "17a05bd0-6937-441b-87a3-ce39c91ed6b5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:31:57.316824 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.316501 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17a05bd0-6937-441b-87a3-ce39c91ed6b5-kube-api-access-76t69" (OuterVolumeSpecName: "kube-api-access-76t69") pod "17a05bd0-6937-441b-87a3-ce39c91ed6b5" (UID: "17a05bd0-6937-441b-87a3-ce39c91ed6b5"). InnerVolumeSpecName "kube-api-access-76t69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:31:57.415883 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.415848 2609 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/17a05bd0-6937-441b-87a3-ce39c91ed6b5-extensions-socket-volume\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:31:57.415883 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:57.415879 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76t69\" (UniqueName: \"kubernetes.io/projected/17a05bd0-6937-441b-87a3-ce39c91ed6b5-kube-api-access-76t69\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:31:58.006705 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.006669 2609 generic.go:358] "Generic (PLEG): container finished" podID="17a05bd0-6937-441b-87a3-ce39c91ed6b5" containerID="bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6" exitCode=0 Jun 02 01:31:58.006944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.006750 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" event={"ID":"17a05bd0-6937-441b-87a3-ce39c91ed6b5","Type":"ContainerDied","Data":"bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6"} Jun 02 01:31:58.006944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.006785 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" event={"ID":"17a05bd0-6937-441b-87a3-ce39c91ed6b5","Type":"ContainerDied","Data":"473db9884f3e725f5559e9723c7f47486cf233bac11314603e8f81838601b797"} Jun 02 01:31:58.006944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.006804 2609 scope.go:117] "RemoveContainer" containerID="bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6" Jun 02 01:31:58.006944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.006755 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn" Jun 02 01:31:58.016679 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.016662 2609 scope.go:117] "RemoveContainer" containerID="bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6" Jun 02 01:31:58.016913 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:31:58.016893 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6\": container with ID starting with bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6 not found: ID does not exist" containerID="bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6" Jun 02 01:31:58.016984 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.016940 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6"} err="failed to get container status \"bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6\": rpc error: code = NotFound desc = could not find container \"bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6\": container with ID starting with bdb143ff1d30de65d9fe6ce0bcc9ec84097ff8ef40ac3bf6da326f15b8c2c1e6 not found: ID does not exist" Jun 02 01:31:58.029720 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.029689 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn"] Jun 02 01:31:58.035309 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.035287 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-52zwn"] Jun 02 01:31:58.937864 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:31:58.937830 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17a05bd0-6937-441b-87a3-ce39c91ed6b5" path="/var/lib/kubelet/pods/17a05bd0-6937-441b-87a3-ce39c91ed6b5/volumes" Jun 02 01:32:01.265111 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.265081 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f"] Jun 02 01:32:01.265479 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.265469 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17a05bd0-6937-441b-87a3-ce39c91ed6b5" containerName="manager" Jun 02 01:32:01.265479 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.265480 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="17a05bd0-6937-441b-87a3-ce39c91ed6b5" containerName="manager" Jun 02 01:32:01.265577 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.265558 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="17a05bd0-6937-441b-87a3-ce39c91ed6b5" containerName="manager" Jun 02 01:32:01.270167 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.270141 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.272473 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.272451 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-r8vbl\"" Jun 02 01:32:01.284703 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.284677 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f"] Jun 02 01:32:01.352093 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352062 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352213 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352095 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ljj8\" (UniqueName: \"kubernetes.io/projected/1c82baf2-514a-4665-b8cb-dea2d5e063a9-kube-api-access-4ljj8\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352213 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352116 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352307 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352238 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352307 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352262 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352307 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352283 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352438 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352361 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352438 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352405 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.352438 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.352429 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453225 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453188 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453400 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453233 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453469 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453407 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453469 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453450 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453616 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453471 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ljj8\" (UniqueName: \"kubernetes.io/projected/1c82baf2-514a-4665-b8cb-dea2d5e063a9-kube-api-access-4ljj8\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453616 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453504 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453727 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453632 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453727 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453663 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453727 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453678 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453727 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453698 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453935 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453739 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.453935 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453913 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.454020 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.453944 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.454170 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.454152 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.455826 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.455802 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.455936 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.455859 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.461311 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.461285 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c82baf2-514a-4665-b8cb-dea2d5e063a9-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.461517 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.461499 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ljj8\" (UniqueName: \"kubernetes.io/projected/1c82baf2-514a-4665-b8cb-dea2d5e063a9-kube-api-access-4ljj8\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-h7t2f\" (UID: \"1c82baf2-514a-4665-b8cb-dea2d5e063a9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.583413 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.583354 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:01.720600 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.720568 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f"] Jun 02 01:32:01.721821 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:32:01.721796 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c82baf2_514a_4665_b8cb_dea2d5e063a9.slice/crio-984c6a87c360d07c9ef1ef2e0f421f3020438ba95a0b7db26091bbcf1a55b1d2 WatchSource:0}: Error finding container 984c6a87c360d07c9ef1ef2e0f421f3020438ba95a0b7db26091bbcf1a55b1d2: Status 404 returned error can't find the container with id 984c6a87c360d07c9ef1ef2e0f421f3020438ba95a0b7db26091bbcf1a55b1d2 Jun 02 01:32:01.723890 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.723862 2609 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 01:32:01.723990 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.723923 2609 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 01:32:01.723990 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:01.723950 2609 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 02 01:32:02.025301 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:02.025262 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" event={"ID":"1c82baf2-514a-4665-b8cb-dea2d5e063a9","Type":"ContainerStarted","Data":"e725110d6200c6a07d90232ba492ac8718181c0f94357a34635179fa0523cfe4"} Jun 02 01:32:02.025482 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:02.025309 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" event={"ID":"1c82baf2-514a-4665-b8cb-dea2d5e063a9","Type":"ContainerStarted","Data":"984c6a87c360d07c9ef1ef2e0f421f3020438ba95a0b7db26091bbcf1a55b1d2"} Jun 02 01:32:02.046101 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:02.046037 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" podStartSLOduration=1.046024286 podStartE2EDuration="1.046024286s" podCreationTimestamp="2026-06-02 01:32:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:32:02.043336752 +0000 UTC m=+549.738259055" watchObservedRunningTime="2026-06-02 01:32:02.046024286 +0000 UTC m=+549.740946659" Jun 02 01:32:02.583506 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:02.583479 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:02.588290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:02.588267 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:03.028367 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:03.028337 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:03.029397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:03.029375 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-h7t2f" Jun 02 01:32:06.425993 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:06.425965 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:32:06.426425 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:06.426064 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:32:06.430636 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:06.430614 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:32:07.047380 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:07.047348 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b7f4f8cd6-sp6d9" Jun 02 01:32:07.091624 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:07.091591 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6d495958-h2vfd"] Jun 02 01:32:18.893512 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:18.893478 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-297xb"] Jun 02 01:32:18.896057 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:18.896041 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-297xb" Jun 02 01:32:18.899801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:18.899776 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwtp8\" (UniqueName: \"kubernetes.io/projected/ac2c36a2-766b-4e95-bd4c-95ffbab1a127-kube-api-access-lwtp8\") pod \"authorino-f99f4b5cd-297xb\" (UID: \"ac2c36a2-766b-4e95-bd4c-95ffbab1a127\") " pod="kuadrant-system/authorino-f99f4b5cd-297xb" Jun 02 01:32:18.899903 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:18.899850 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z4wzl\"" Jun 02 01:32:18.907895 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:18.907871 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-297xb"] Jun 02 01:32:19.000652 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:19.000617 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lwtp8\" (UniqueName: \"kubernetes.io/projected/ac2c36a2-766b-4e95-bd4c-95ffbab1a127-kube-api-access-lwtp8\") pod \"authorino-f99f4b5cd-297xb\" (UID: \"ac2c36a2-766b-4e95-bd4c-95ffbab1a127\") " pod="kuadrant-system/authorino-f99f4b5cd-297xb" Jun 02 01:32:19.013935 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:19.013908 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwtp8\" (UniqueName: \"kubernetes.io/projected/ac2c36a2-766b-4e95-bd4c-95ffbab1a127-kube-api-access-lwtp8\") pod \"authorino-f99f4b5cd-297xb\" (UID: \"ac2c36a2-766b-4e95-bd4c-95ffbab1a127\") " pod="kuadrant-system/authorino-f99f4b5cd-297xb" Jun 02 01:32:19.206601 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:19.206575 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-297xb" Jun 02 01:32:19.338963 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:19.338935 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-297xb"] Jun 02 01:32:19.340323 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:32:19.340290 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac2c36a2_766b_4e95_bd4c_95ffbab1a127.slice/crio-1661a80983b35fd9db8385972f1be4f7cf89965cd9e38871819f51d44145ff01 WatchSource:0}: Error finding container 1661a80983b35fd9db8385972f1be4f7cf89965cd9e38871819f51d44145ff01: Status 404 returned error can't find the container with id 1661a80983b35fd9db8385972f1be4f7cf89965cd9e38871819f51d44145ff01 Jun 02 01:32:20.103222 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:20.103181 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-297xb" event={"ID":"ac2c36a2-766b-4e95-bd4c-95ffbab1a127","Type":"ContainerStarted","Data":"1661a80983b35fd9db8385972f1be4f7cf89965cd9e38871819f51d44145ff01"} Jun 02 01:32:23.120858 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:23.120814 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-297xb" event={"ID":"ac2c36a2-766b-4e95-bd4c-95ffbab1a127","Type":"ContainerStarted","Data":"be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64"} Jun 02 01:32:23.137092 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:23.137045 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-297xb" podStartSLOduration=1.497050095 podStartE2EDuration="5.137031442s" podCreationTimestamp="2026-06-02 01:32:18 +0000 UTC" firstStartedPulling="2026-06-02 01:32:19.341805369 +0000 UTC m=+567.036727648" lastFinishedPulling="2026-06-02 01:32:22.981786704 +0000 UTC m=+570.676708995" observedRunningTime="2026-06-02 01:32:23.134288139 +0000 UTC m=+570.829210441" watchObservedRunningTime="2026-06-02 01:32:23.137031442 +0000 UTC m=+570.831953744" Jun 02 01:32:24.238946 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:24.238916 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-297xb"] Jun 02 01:32:25.129465 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:25.129423 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-297xb" podUID="ac2c36a2-766b-4e95-bd4c-95ffbab1a127" containerName="authorino" containerID="cri-o://be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64" gracePeriod=30 Jun 02 01:32:25.372886 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:25.372861 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-297xb" Jun 02 01:32:25.455849 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:25.455823 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwtp8\" (UniqueName: \"kubernetes.io/projected/ac2c36a2-766b-4e95-bd4c-95ffbab1a127-kube-api-access-lwtp8\") pod \"ac2c36a2-766b-4e95-bd4c-95ffbab1a127\" (UID: \"ac2c36a2-766b-4e95-bd4c-95ffbab1a127\") " Jun 02 01:32:25.457946 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:25.457925 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2c36a2-766b-4e95-bd4c-95ffbab1a127-kube-api-access-lwtp8" (OuterVolumeSpecName: "kube-api-access-lwtp8") pod "ac2c36a2-766b-4e95-bd4c-95ffbab1a127" (UID: "ac2c36a2-766b-4e95-bd4c-95ffbab1a127"). InnerVolumeSpecName "kube-api-access-lwtp8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:32:25.557391 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:25.557358 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwtp8\" (UniqueName: \"kubernetes.io/projected/ac2c36a2-766b-4e95-bd4c-95ffbab1a127-kube-api-access-lwtp8\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:26.134288 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.134256 2609 generic.go:358] "Generic (PLEG): container finished" podID="ac2c36a2-766b-4e95-bd4c-95ffbab1a127" containerID="be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64" exitCode=0 Jun 02 01:32:26.134492 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.134310 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-297xb" Jun 02 01:32:26.134492 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.134342 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-297xb" event={"ID":"ac2c36a2-766b-4e95-bd4c-95ffbab1a127","Type":"ContainerDied","Data":"be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64"} Jun 02 01:32:26.134492 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.134384 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-297xb" event={"ID":"ac2c36a2-766b-4e95-bd4c-95ffbab1a127","Type":"ContainerDied","Data":"1661a80983b35fd9db8385972f1be4f7cf89965cd9e38871819f51d44145ff01"} Jun 02 01:32:26.134492 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.134403 2609 scope.go:117] "RemoveContainer" containerID="be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64" Jun 02 01:32:26.144614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.144596 2609 scope.go:117] "RemoveContainer" containerID="be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64" Jun 02 01:32:26.144837 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:32:26.144819 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64\": container with ID starting with be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64 not found: ID does not exist" containerID="be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64" Jun 02 01:32:26.144885 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.144847 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64"} err="failed to get container status \"be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64\": rpc error: code = NotFound desc = could not find container \"be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64\": container with ID starting with be8607c212f2ae541c79d2874bca7a1da9cc233e6b861101b42e50558b3edf64 not found: ID does not exist" Jun 02 01:32:26.155077 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.155058 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-297xb"] Jun 02 01:32:26.162483 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.162452 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-297xb"] Jun 02 01:32:26.937968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:26.937926 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2c36a2-766b-4e95-bd4c-95ffbab1a127" path="/var/lib/kubelet/pods/ac2c36a2-766b-4e95-bd4c-95ffbab1a127/volumes" Jun 02 01:32:32.116808 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.116748 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-5b6d495958-h2vfd" podUID="cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" containerName="console" containerID="cri-o://3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec" gracePeriod=15 Jun 02 01:32:32.379725 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.379662 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b6d495958-h2vfd_cf5cb5a3-5314-4be5-9fb4-3d3a68313b41/console/0.log" Jun 02 01:32:32.379725 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.379721 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:32:32.416389 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416356 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-oauth-config\") pod \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " Jun 02 01:32:32.416621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416431 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-trusted-ca-bundle\") pod \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " Jun 02 01:32:32.416621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416467 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-oauth-serving-cert\") pod \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " Jun 02 01:32:32.416621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416508 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-serving-cert\") pod \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " Jun 02 01:32:32.416806 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416737 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-config\") pod \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " Jun 02 01:32:32.416806 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416782 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-service-ca\") pod \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " Jun 02 01:32:32.416913 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416811 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sl76\" (UniqueName: \"kubernetes.io/projected/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-kube-api-access-4sl76\") pod \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\" (UID: \"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41\") " Jun 02 01:32:32.417053 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.416967 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" (UID: "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:32:32.417141 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.417101 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-config" (OuterVolumeSpecName: "console-config") pod "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" (UID: "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:32:32.417257 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.417236 2609 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:32.417301 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.417265 2609 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-trusted-ca-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:32.417336 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.417167 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" (UID: "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:32:32.417442 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.417422 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" (UID: "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:32:32.419006 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.418977 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" (UID: "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:32:32.419137 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.419076 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" (UID: "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:32:32.419402 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.419377 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-kube-api-access-4sl76" (OuterVolumeSpecName: "kube-api-access-4sl76") pod "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" (UID: "cf5cb5a3-5314-4be5-9fb4-3d3a68313b41"). InnerVolumeSpecName "kube-api-access-4sl76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:32:32.518197 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.518159 2609 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-oauth-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:32.518197 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.518188 2609 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-serving-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:32.518197 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.518198 2609 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-service-ca\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:32.518419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.518207 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sl76\" (UniqueName: \"kubernetes.io/projected/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-kube-api-access-4sl76\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:32.518419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:32.518218 2609 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41-console-oauth-config\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:33.166596 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.166571 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b6d495958-h2vfd_cf5cb5a3-5314-4be5-9fb4-3d3a68313b41/console/0.log" Jun 02 01:32:33.166968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.166610 2609 generic.go:358] "Generic (PLEG): container finished" podID="cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" containerID="3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec" exitCode=2 Jun 02 01:32:33.166968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.166699 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6d495958-h2vfd" Jun 02 01:32:33.166968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.166706 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d495958-h2vfd" event={"ID":"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41","Type":"ContainerDied","Data":"3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec"} Jun 02 01:32:33.166968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.166748 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6d495958-h2vfd" event={"ID":"cf5cb5a3-5314-4be5-9fb4-3d3a68313b41","Type":"ContainerDied","Data":"4bf91163964baac78bc94c5d1703b013277670057a10c7acf59cf96c3382c8c6"} Jun 02 01:32:33.166968 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.166763 2609 scope.go:117] "RemoveContainer" containerID="3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec" Jun 02 01:32:33.176198 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.176182 2609 scope.go:117] "RemoveContainer" containerID="3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec" Jun 02 01:32:33.176454 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:32:33.176436 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec\": container with ID starting with 3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec not found: ID does not exist" containerID="3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec" Jun 02 01:32:33.176506 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.176462 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec"} err="failed to get container status \"3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec\": rpc error: code = NotFound desc = could not find container \"3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec\": container with ID starting with 3057c2b5206c668588648031bd44c647ade9a5d935ddd3b15f8888195506a0ec not found: ID does not exist" Jun 02 01:32:33.184220 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.184197 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6d495958-h2vfd"] Jun 02 01:32:33.188312 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:33.188290 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b6d495958-h2vfd"] Jun 02 01:32:34.937323 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:34.937287 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" path="/var/lib/kubelet/pods/cf5cb5a3-5314-4be5-9fb4-3d3a68313b41/volumes" Jun 02 01:32:48.521333 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.521302 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk"] Jun 02 01:32:48.521814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.521696 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2c36a2-766b-4e95-bd4c-95ffbab1a127" containerName="authorino" Jun 02 01:32:48.521814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.521708 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2c36a2-766b-4e95-bd4c-95ffbab1a127" containerName="authorino" Jun 02 01:32:48.521814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.521718 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" containerName="console" Jun 02 01:32:48.521814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.521724 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" containerName="console" Jun 02 01:32:48.521814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.521797 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="ac2c36a2-766b-4e95-bd4c-95ffbab1a127" containerName="authorino" Jun 02 01:32:48.521814 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.521806 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="cf5cb5a3-5314-4be5-9fb4-3d3a68313b41" containerName="console" Jun 02 01:32:48.528487 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.528466 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.531162 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.531126 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 01:32:48.531281 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.531175 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 01:32:48.531453 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.531432 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9vc5v\"" Jun 02 01:32:48.532693 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.532672 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk"] Jun 02 01:32:48.660034 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.660001 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.660207 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.660101 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.660207 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.660125 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfr5m\" (UniqueName: \"kubernetes.io/projected/6d7fc914-997b-4dc9-a1df-548c756a1baa-kube-api-access-qfr5m\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.761425 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.761392 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.761587 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.761429 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qfr5m\" (UniqueName: \"kubernetes.io/projected/6d7fc914-997b-4dc9-a1df-548c756a1baa-kube-api-access-qfr5m\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.761587 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.761497 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.761868 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.761849 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.761940 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.761870 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.770693 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.770671 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfr5m\" (UniqueName: \"kubernetes.io/projected/6d7fc914-997b-4dc9-a1df-548c756a1baa-kube-api-access-qfr5m\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.839423 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.839369 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:48.971699 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:48.971672 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk"] Jun 02 01:32:48.973479 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:32:48.973448 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7fc914_997b_4dc9_a1df_548c756a1baa.slice/crio-3ef6b486314cb4fb5b73cd3106d6d3e4c98576121f26c3c4940a9c7176aaaab2 WatchSource:0}: Error finding container 3ef6b486314cb4fb5b73cd3106d6d3e4c98576121f26c3c4940a9c7176aaaab2: Status 404 returned error can't find the container with id 3ef6b486314cb4fb5b73cd3106d6d3e4c98576121f26c3c4940a9c7176aaaab2 Jun 02 01:32:49.236332 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:49.236290 2609 generic.go:358] "Generic (PLEG): container finished" podID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerID="1e743e58219dc5b1966e46a4ac4e91d1196dd6b28d0d5f5ed2faf3d0fd021de7" exitCode=0 Jun 02 01:32:49.236492 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:49.236356 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" event={"ID":"6d7fc914-997b-4dc9-a1df-548c756a1baa","Type":"ContainerDied","Data":"1e743e58219dc5b1966e46a4ac4e91d1196dd6b28d0d5f5ed2faf3d0fd021de7"} Jun 02 01:32:49.236492 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:49.236388 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" event={"ID":"6d7fc914-997b-4dc9-a1df-548c756a1baa","Type":"ContainerStarted","Data":"3ef6b486314cb4fb5b73cd3106d6d3e4c98576121f26c3c4940a9c7176aaaab2"} Jun 02 01:32:50.060146 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:32:50.060118 2609 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7fc914_997b_4dc9_a1df_548c756a1baa.slice/crio-bc7bf68d6178fca8fed8f10f3dd5737292e791cb91caa0a163ef930da2084d58.scope\": RecentStats: unable to find data in memory cache]" Jun 02 01:32:50.242461 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:50.242433 2609 generic.go:358] "Generic (PLEG): container finished" podID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerID="bc7bf68d6178fca8fed8f10f3dd5737292e791cb91caa0a163ef930da2084d58" exitCode=0 Jun 02 01:32:50.242620 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:50.242540 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" event={"ID":"6d7fc914-997b-4dc9-a1df-548c756a1baa","Type":"ContainerDied","Data":"bc7bf68d6178fca8fed8f10f3dd5737292e791cb91caa0a163ef930da2084d58"} Jun 02 01:32:51.248445 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:51.248409 2609 generic.go:358] "Generic (PLEG): container finished" podID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerID="814a5b62d6c5af6667d68a3a7a83e3cf65a1c678d5739bc828ceb8ea99878521" exitCode=0 Jun 02 01:32:51.248835 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:51.248492 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" event={"ID":"6d7fc914-997b-4dc9-a1df-548c756a1baa","Type":"ContainerDied","Data":"814a5b62d6c5af6667d68a3a7a83e3cf65a1c678d5739bc828ceb8ea99878521"} Jun 02 01:32:52.383458 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.383437 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:52.496591 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.496559 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-util\") pod \"6d7fc914-997b-4dc9-a1df-548c756a1baa\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " Jun 02 01:32:52.496746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.496618 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfr5m\" (UniqueName: \"kubernetes.io/projected/6d7fc914-997b-4dc9-a1df-548c756a1baa-kube-api-access-qfr5m\") pod \"6d7fc914-997b-4dc9-a1df-548c756a1baa\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " Jun 02 01:32:52.496746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.496673 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-bundle\") pod \"6d7fc914-997b-4dc9-a1df-548c756a1baa\" (UID: \"6d7fc914-997b-4dc9-a1df-548c756a1baa\") " Jun 02 01:32:52.497182 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.497153 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-bundle" (OuterVolumeSpecName: "bundle") pod "6d7fc914-997b-4dc9-a1df-548c756a1baa" (UID: "6d7fc914-997b-4dc9-a1df-548c756a1baa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:32:52.498973 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.498945 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d7fc914-997b-4dc9-a1df-548c756a1baa-kube-api-access-qfr5m" (OuterVolumeSpecName: "kube-api-access-qfr5m") pod "6d7fc914-997b-4dc9-a1df-548c756a1baa" (UID: "6d7fc914-997b-4dc9-a1df-548c756a1baa"). InnerVolumeSpecName "kube-api-access-qfr5m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:32:52.502513 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.502481 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-util" (OuterVolumeSpecName: "util") pod "6d7fc914-997b-4dc9-a1df-548c756a1baa" (UID: "6d7fc914-997b-4dc9-a1df-548c756a1baa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:32:52.597761 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.597714 2609 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-bundle\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:52.597761 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.597757 2609 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6d7fc914-997b-4dc9-a1df-548c756a1baa-util\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:52.597761 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.597768 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfr5m\" (UniqueName: \"kubernetes.io/projected/6d7fc914-997b-4dc9-a1df-548c756a1baa-kube-api-access-qfr5m\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:32:52.861100 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.861024 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:32:52.861369 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.861351 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:32:52.864798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.864776 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:32:52.865064 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:52.865046 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:32:53.258106 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:53.258072 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" event={"ID":"6d7fc914-997b-4dc9-a1df-548c756a1baa","Type":"ContainerDied","Data":"3ef6b486314cb4fb5b73cd3106d6d3e4c98576121f26c3c4940a9c7176aaaab2"} Jun 02 01:32:53.258106 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:53.258112 2609 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ef6b486314cb4fb5b73cd3106d6d3e4c98576121f26c3c4940a9c7176aaaab2" Jun 02 01:32:53.258386 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:53.258086 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a706zcrk" Jun 02 01:32:56.100300 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100270 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-s44m4"] Jun 02 01:32:56.100792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100678 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerName="pull" Jun 02 01:32:56.100792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100689 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerName="pull" Jun 02 01:32:56.100792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100696 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerName="extract" Jun 02 01:32:56.100792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100701 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerName="extract" Jun 02 01:32:56.100792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100725 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerName="util" Jun 02 01:32:56.100792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100730 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerName="util" Jun 02 01:32:56.100792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.100793 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="6d7fc914-997b-4dc9-a1df-548c756a1baa" containerName="extract" Jun 02 01:32:56.105363 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.105349 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" Jun 02 01:32:56.107813 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.107789 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 01:32:56.107946 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.107872 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 01:32:56.108782 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.108745 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-ccg4b\"" Jun 02 01:32:56.113089 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.112815 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-s44m4"] Jun 02 01:32:56.230674 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.230646 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bckrr\" (UniqueName: \"kubernetes.io/projected/c50af3d7-7911-4fe0-9f6e-b5d10c86cc27-kube-api-access-bckrr\") pod \"keycloak-operator-7864d68cbd-s44m4\" (UID: \"c50af3d7-7911-4fe0-9f6e-b5d10c86cc27\") " pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" Jun 02 01:32:56.331389 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.331357 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bckrr\" (UniqueName: \"kubernetes.io/projected/c50af3d7-7911-4fe0-9f6e-b5d10c86cc27-kube-api-access-bckrr\") pod \"keycloak-operator-7864d68cbd-s44m4\" (UID: \"c50af3d7-7911-4fe0-9f6e-b5d10c86cc27\") " pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" Jun 02 01:32:56.341991 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.341959 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bckrr\" (UniqueName: \"kubernetes.io/projected/c50af3d7-7911-4fe0-9f6e-b5d10c86cc27-kube-api-access-bckrr\") pod \"keycloak-operator-7864d68cbd-s44m4\" (UID: \"c50af3d7-7911-4fe0-9f6e-b5d10c86cc27\") " pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" Jun 02 01:32:56.416027 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.415948 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" Jun 02 01:32:56.553139 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:56.553114 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-s44m4"] Jun 02 01:32:56.554951 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:32:56.554915 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50af3d7_7911_4fe0_9f6e_b5d10c86cc27.slice/crio-3ada451643ac78f032e5925c37b440e350b680378c48f279f090984c9adb2796 WatchSource:0}: Error finding container 3ada451643ac78f032e5925c37b440e350b680378c48f279f090984c9adb2796: Status 404 returned error can't find the container with id 3ada451643ac78f032e5925c37b440e350b680378c48f279f090984c9adb2796 Jun 02 01:32:57.279783 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:32:57.279745 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" event={"ID":"c50af3d7-7911-4fe0-9f6e-b5d10c86cc27","Type":"ContainerStarted","Data":"3ada451643ac78f032e5925c37b440e350b680378c48f279f090984c9adb2796"} Jun 02 01:33:03.314489 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:03.314454 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" event={"ID":"c50af3d7-7911-4fe0-9f6e-b5d10c86cc27","Type":"ContainerStarted","Data":"f46ddd58d58aac23a17dab93eb8934a70ad14bbf510dd0a870c65d7c20448df9"} Jun 02 01:33:03.332582 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:03.332507 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-s44m4" podStartSLOduration=1.1401784209999999 podStartE2EDuration="7.332488794s" podCreationTimestamp="2026-06-02 01:32:56 +0000 UTC" firstStartedPulling="2026-06-02 01:32:56.556472137 +0000 UTC m=+604.251394421" lastFinishedPulling="2026-06-02 01:33:02.7487825 +0000 UTC m=+610.443704794" observedRunningTime="2026-06-02 01:33:03.332123782 +0000 UTC m=+611.027046084" watchObservedRunningTime="2026-06-02 01:33:03.332488794 +0000 UTC m=+611.027411097" Jun 02 01:33:41.279255 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.279220 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ftp5r"] Jun 02 01:33:41.281589 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.281570 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ftp5r" Jun 02 01:33:41.283767 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.283739 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z4wzl\"" Jun 02 01:33:41.287496 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.287475 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ftp5r"] Jun 02 01:33:41.417971 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.417940 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcc5v\" (UniqueName: \"kubernetes.io/projected/52a4ea46-82aa-431a-9e63-ddcdfd12b751-kube-api-access-dcc5v\") pod \"authorino-8b475cf9f-ftp5r\" (UID: \"52a4ea46-82aa-431a-9e63-ddcdfd12b751\") " pod="kuadrant-system/authorino-8b475cf9f-ftp5r" Jun 02 01:33:41.503121 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.503090 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ftp5r"] Jun 02 01:33:41.503366 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:33:41.503347 2609 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dcc5v], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-ftp5r" podUID="52a4ea46-82aa-431a-9e63-ddcdfd12b751" Jun 02 01:33:41.519066 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.519040 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dcc5v\" (UniqueName: \"kubernetes.io/projected/52a4ea46-82aa-431a-9e63-ddcdfd12b751-kube-api-access-dcc5v\") pod \"authorino-8b475cf9f-ftp5r\" (UID: \"52a4ea46-82aa-431a-9e63-ddcdfd12b751\") " pod="kuadrant-system/authorino-8b475cf9f-ftp5r" Jun 02 01:33:41.528614 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.528593 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5649b85d9d-bhrr9"] Jun 02 01:33:41.531189 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.531141 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.533127 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.533107 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcc5v\" (UniqueName: \"kubernetes.io/projected/52a4ea46-82aa-431a-9e63-ddcdfd12b751-kube-api-access-dcc5v\") pod \"authorino-8b475cf9f-ftp5r\" (UID: \"52a4ea46-82aa-431a-9e63-ddcdfd12b751\") " pod="kuadrant-system/authorino-8b475cf9f-ftp5r" Jun 02 01:33:41.533228 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.533162 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 02 01:33:41.541433 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.541413 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5649b85d9d-bhrr9"] Jun 02 01:33:41.620488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.620461 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-tls-cert\") pod \"authorino-5649b85d9d-bhrr9\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.620664 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.620509 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcfmg\" (UniqueName: \"kubernetes.io/projected/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-kube-api-access-mcfmg\") pod \"authorino-5649b85d9d-bhrr9\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.721482 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.721453 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-tls-cert\") pod \"authorino-5649b85d9d-bhrr9\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.721668 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.721496 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcfmg\" (UniqueName: \"kubernetes.io/projected/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-kube-api-access-mcfmg\") pod \"authorino-5649b85d9d-bhrr9\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.724183 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.724159 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-tls-cert\") pod \"authorino-5649b85d9d-bhrr9\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.728722 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.728701 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcfmg\" (UniqueName: \"kubernetes.io/projected/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-kube-api-access-mcfmg\") pod \"authorino-5649b85d9d-bhrr9\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.850642 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.850569 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:33:41.976348 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.976322 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5649b85d9d-bhrr9"] Jun 02 01:33:41.977943 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:33:41.977912 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11f5c8c7_8ef0_48e9_ab77_35380c2f2171.slice/crio-f63e49ea917fb1a93840a5bc283c3ed04abcc56ad9b34a2b391bb42915e564c8 WatchSource:0}: Error finding container f63e49ea917fb1a93840a5bc283c3ed04abcc56ad9b34a2b391bb42915e564c8: Status 404 returned error can't find the container with id f63e49ea917fb1a93840a5bc283c3ed04abcc56ad9b34a2b391bb42915e564c8 Jun 02 01:33:41.979212 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:41.979195 2609 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:33:42.483517 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:42.483483 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" event={"ID":"11f5c8c7-8ef0-48e9-ab77-35380c2f2171","Type":"ContainerStarted","Data":"f63e49ea917fb1a93840a5bc283c3ed04abcc56ad9b34a2b391bb42915e564c8"} Jun 02 01:33:42.483517 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:42.483506 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ftp5r" Jun 02 01:33:42.488724 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:42.488703 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ftp5r" Jun 02 01:33:42.629604 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:42.629568 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcc5v\" (UniqueName: \"kubernetes.io/projected/52a4ea46-82aa-431a-9e63-ddcdfd12b751-kube-api-access-dcc5v\") pod \"52a4ea46-82aa-431a-9e63-ddcdfd12b751\" (UID: \"52a4ea46-82aa-431a-9e63-ddcdfd12b751\") " Jun 02 01:33:42.631897 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:42.631856 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52a4ea46-82aa-431a-9e63-ddcdfd12b751-kube-api-access-dcc5v" (OuterVolumeSpecName: "kube-api-access-dcc5v") pod "52a4ea46-82aa-431a-9e63-ddcdfd12b751" (UID: "52a4ea46-82aa-431a-9e63-ddcdfd12b751"). InnerVolumeSpecName "kube-api-access-dcc5v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:33:42.731007 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:42.730975 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcc5v\" (UniqueName: \"kubernetes.io/projected/52a4ea46-82aa-431a-9e63-ddcdfd12b751-kube-api-access-dcc5v\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:33:43.489944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:43.489912 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-ftp5r" Jun 02 01:33:43.489944 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:43.489918 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" event={"ID":"11f5c8c7-8ef0-48e9-ab77-35380c2f2171","Type":"ContainerStarted","Data":"c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c"} Jun 02 01:33:43.508691 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:43.508652 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" podStartSLOduration=1.999759184 podStartE2EDuration="2.508638554s" podCreationTimestamp="2026-06-02 01:33:41 +0000 UTC" firstStartedPulling="2026-06-02 01:33:41.979324987 +0000 UTC m=+649.674247267" lastFinishedPulling="2026-06-02 01:33:42.488204356 +0000 UTC m=+650.183126637" observedRunningTime="2026-06-02 01:33:43.505091493 +0000 UTC m=+651.200013790" watchObservedRunningTime="2026-06-02 01:33:43.508638554 +0000 UTC m=+651.203560856" Jun 02 01:33:43.541678 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:43.541644 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ftp5r"] Jun 02 01:33:43.546078 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:43.546055 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-ftp5r"] Jun 02 01:33:44.940118 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:33:44.940082 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52a4ea46-82aa-431a-9e63-ddcdfd12b751" path="/var/lib/kubelet/pods/52a4ea46-82aa-431a-9e63-ddcdfd12b751/volumes" Jun 02 01:35:11.816703 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:11.816500 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5649b85d9d-bhrr9"] Jun 02 01:35:11.817737 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:11.817675 2609 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" podUID="11f5c8c7-8ef0-48e9-ab77-35380c2f2171" containerName="authorino" containerID="cri-o://c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c" gracePeriod=30 Jun 02 01:35:12.075795 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.075737 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:35:12.198958 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.198926 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-tls-cert\") pod \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " Jun 02 01:35:12.199122 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.198980 2609 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcfmg\" (UniqueName: \"kubernetes.io/projected/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-kube-api-access-mcfmg\") pod \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\" (UID: \"11f5c8c7-8ef0-48e9-ab77-35380c2f2171\") " Jun 02 01:35:12.201633 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.201601 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-kube-api-access-mcfmg" (OuterVolumeSpecName: "kube-api-access-mcfmg") pod "11f5c8c7-8ef0-48e9-ab77-35380c2f2171" (UID: "11f5c8c7-8ef0-48e9-ab77-35380c2f2171"). InnerVolumeSpecName "kube-api-access-mcfmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:35:12.211002 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.210969 2609 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "11f5c8c7-8ef0-48e9-ab77-35380c2f2171" (UID: "11f5c8c7-8ef0-48e9-ab77-35380c2f2171"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:35:12.299894 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.299858 2609 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-tls-cert\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:35:12.299894 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.299890 2609 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcfmg\" (UniqueName: \"kubernetes.io/projected/11f5c8c7-8ef0-48e9-ab77-35380c2f2171-kube-api-access-mcfmg\") on node \"ip-10-0-140-112.ec2.internal\" DevicePath \"\"" Jun 02 01:35:12.850096 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.850062 2609 generic.go:358] "Generic (PLEG): container finished" podID="11f5c8c7-8ef0-48e9-ab77-35380c2f2171" containerID="c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c" exitCode=0 Jun 02 01:35:12.850586 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.850113 2609 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" Jun 02 01:35:12.850586 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.850152 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" event={"ID":"11f5c8c7-8ef0-48e9-ab77-35380c2f2171","Type":"ContainerDied","Data":"c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c"} Jun 02 01:35:12.850586 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.850188 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5649b85d9d-bhrr9" event={"ID":"11f5c8c7-8ef0-48e9-ab77-35380c2f2171","Type":"ContainerDied","Data":"f63e49ea917fb1a93840a5bc283c3ed04abcc56ad9b34a2b391bb42915e564c8"} Jun 02 01:35:12.850586 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.850203 2609 scope.go:117] "RemoveContainer" containerID="c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c" Jun 02 01:35:12.860391 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.860364 2609 scope.go:117] "RemoveContainer" containerID="c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c" Jun 02 01:35:12.860661 ip-10-0-140-112 kubenswrapper[2609]: E0602 01:35:12.860638 2609 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c\": container with ID starting with c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c not found: ID does not exist" containerID="c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c" Jun 02 01:35:12.860727 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.860672 2609 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c"} err="failed to get container status \"c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c\": rpc error: code = NotFound desc = could not find container \"c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c\": container with ID starting with c1f61a69330c66da8748941bc57a2a16b8ba3262733683bf1f6734fc9b46794c not found: ID does not exist" Jun 02 01:35:12.870641 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.870613 2609 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5649b85d9d-bhrr9"] Jun 02 01:35:12.874539 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.874505 2609 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5649b85d9d-bhrr9"] Jun 02 01:35:12.937746 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:12.937723 2609 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11f5c8c7-8ef0-48e9-ab77-35380c2f2171" path="/var/lib/kubelet/pods/11f5c8c7-8ef0-48e9-ab77-35380c2f2171/volumes" Jun 02 01:35:26.099795 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.099760 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk"] Jun 02 01:35:26.100377 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.100359 2609 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11f5c8c7-8ef0-48e9-ab77-35380c2f2171" containerName="authorino" Jun 02 01:35:26.100448 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.100378 2609 state_mem.go:107] "Deleted CPUSet assignment" podUID="11f5c8c7-8ef0-48e9-ab77-35380c2f2171" containerName="authorino" Jun 02 01:35:26.100506 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.100457 2609 memory_manager.go:356] "RemoveStaleState removing state" podUID="11f5c8c7-8ef0-48e9-ab77-35380c2f2171" containerName="authorino" Jun 02 01:35:26.105045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.105024 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.107695 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.107675 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hpnsh\"" Jun 02 01:35:26.108424 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.108402 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 01:35:26.108631 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.108434 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 01:35:26.108795 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.108497 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 01:35:26.112298 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.112274 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk"] Jun 02 01:35:26.222240 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.222213 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d394e32f-a390-46bc-a2a0-666cb211a536-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.222417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.222245 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.222417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.222285 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.222417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.222373 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.222417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.222401 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cgf6\" (UniqueName: \"kubernetes.io/projected/d394e32f-a390-46bc-a2a0-666cb211a536-kube-api-access-5cgf6\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.222604 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.222430 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323363 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323330 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323568 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323374 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323568 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323395 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5cgf6\" (UniqueName: \"kubernetes.io/projected/d394e32f-a390-46bc-a2a0-666cb211a536-kube-api-access-5cgf6\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323568 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323426 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323568 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323509 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d394e32f-a390-46bc-a2a0-666cb211a536-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323568 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323559 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323852 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323831 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323902 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323848 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.323960 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.323942 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.325945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.325922 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d394e32f-a390-46bc-a2a0-666cb211a536-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.326057 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.326036 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d394e32f-a390-46bc-a2a0-666cb211a536-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.332154 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.332135 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cgf6\" (UniqueName: \"kubernetes.io/projected/d394e32f-a390-46bc-a2a0-666cb211a536-kube-api-access-5cgf6\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk\" (UID: \"d394e32f-a390-46bc-a2a0-666cb211a536\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.416947 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.416860 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:26.550065 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.550034 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk"] Jun 02 01:35:26.551338 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:35:26.551300 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd394e32f_a390_46bc_a2a0_666cb211a536.slice/crio-6322f67eea4a3910860fb7df4319f5d7ed1b8dcac7710fd8f81f14e7d1ea9c80 WatchSource:0}: Error finding container 6322f67eea4a3910860fb7df4319f5d7ed1b8dcac7710fd8f81f14e7d1ea9c80: Status 404 returned error can't find the container with id 6322f67eea4a3910860fb7df4319f5d7ed1b8dcac7710fd8f81f14e7d1ea9c80 Jun 02 01:35:26.908334 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:26.908301 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" event={"ID":"d394e32f-a390-46bc-a2a0-666cb211a536","Type":"ContainerStarted","Data":"6322f67eea4a3910860fb7df4319f5d7ed1b8dcac7710fd8f81f14e7d1ea9c80"} Jun 02 01:35:30.941980 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:30.941947 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" event={"ID":"d394e32f-a390-46bc-a2a0-666cb211a536","Type":"ContainerStarted","Data":"9710a5a1c6e86ac60c0e4e9ead2d2567820dc6eab88229ca7be8188f0ab588ba"} Jun 02 01:35:33.954981 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:33.954952 2609 generic.go:358] "Generic (PLEG): container finished" podID="d394e32f-a390-46bc-a2a0-666cb211a536" containerID="9710a5a1c6e86ac60c0e4e9ead2d2567820dc6eab88229ca7be8188f0ab588ba" exitCode=0 Jun 02 01:35:33.955397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:33.955010 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" event={"ID":"d394e32f-a390-46bc-a2a0-666cb211a536","Type":"ContainerDied","Data":"9710a5a1c6e86ac60c0e4e9ead2d2567820dc6eab88229ca7be8188f0ab588ba"} Jun 02 01:35:35.964788 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:35.964748 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" event={"ID":"d394e32f-a390-46bc-a2a0-666cb211a536","Type":"ContainerStarted","Data":"57b2cc7c6ce5d78777b150d791ca0b02a5d6985bbe7736e6ed2368b12e422e4e"} Jun 02 01:35:35.984612 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:35.984563 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" podStartSLOduration=1.518004029 podStartE2EDuration="9.98454964s" podCreationTimestamp="2026-06-02 01:35:26 +0000 UTC" firstStartedPulling="2026-06-02 01:35:26.553283514 +0000 UTC m=+754.248205794" lastFinishedPulling="2026-06-02 01:35:35.019829125 +0000 UTC m=+762.714751405" observedRunningTime="2026-06-02 01:35:35.981501397 +0000 UTC m=+763.676423699" watchObservedRunningTime="2026-06-02 01:35:35.98454964 +0000 UTC m=+763.679471942" Jun 02 01:35:36.417297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:36.417204 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:36.417297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:36.417247 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:36.429844 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:36.429820 2609 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:35:36.980298 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:35:36.980266 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk" Jun 02 01:37:52.896483 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:37:52.896453 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:37:52.899045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:37:52.899025 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:37:52.900180 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:37:52.900155 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:37:52.903009 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:37:52.902992 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:42:08.440999 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:08.440912 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7598c6c7c5-kgdsj_cca0008d-1f02-42c8-8de0-fb6668c94d4d/nginx/0.log" Jun 02 01:42:09.255512 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:09.255484 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-5kjfm_a76468f8-101c-4354-aa6c-2294a0491e2e/copy-manifests/0.log" Jun 02 01:42:09.262314 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:09.262294 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-5kjfm_a76468f8-101c-4354-aa6c-2294a0491e2e/manager/0.log" Jun 02 01:42:10.428491 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.428461 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6_e9d800de-a142-4026-be95-d3afa173cb37/util/0.log" Jun 02 01:42:10.434566 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.434517 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6_e9d800de-a142-4026-be95-d3afa173cb37/pull/0.log" Jun 02 01:42:10.440273 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.440229 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6_e9d800de-a142-4026-be95-d3afa173cb37/extract/0.log" Jun 02 01:42:10.555555 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.555506 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7_b2f54f8d-e376-40ab-9410-dd2ad6ab49b0/util/0.log" Jun 02 01:42:10.561851 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.561829 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7_b2f54f8d-e376-40ab-9410-dd2ad6ab49b0/pull/0.log" Jun 02 01:42:10.568986 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.568964 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7_b2f54f8d-e376-40ab-9410-dd2ad6ab49b0/extract/0.log" Jun 02 01:42:10.679677 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.679603 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw_cacdd264-db08-4fdf-ba33-3c29da02dd2a/util/0.log" Jun 02 01:42:10.686616 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.686598 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw_cacdd264-db08-4fdf-ba33-3c29da02dd2a/pull/0.log" Jun 02 01:42:10.692889 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.692872 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw_cacdd264-db08-4fdf-ba33-3c29da02dd2a/extract/0.log" Jun 02 01:42:10.800220 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.800199 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c_81e0303c-2ec1-4ea0-8145-8b6e2b2a276d/util/0.log" Jun 02 01:42:10.806290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.806271 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c_81e0303c-2ec1-4ea0-8145-8b6e2b2a276d/pull/0.log" Jun 02 01:42:10.812616 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:10.812600 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c_81e0303c-2ec1-4ea0-8145-8b6e2b2a276d/extract/0.log" Jun 02 01:42:11.045127 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:11.045040 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-lnhr5_faeb1c35-8360-478e-81c5-6e5e7d5d2a69/manager/0.log" Jun 02 01:42:11.154969 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:11.154942 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-258fg_ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa/manager/0.log" Jun 02 01:42:11.377045 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:11.376976 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mggsr_fe3da251-e829-41d2-9dce-ab560b114834/registry-server/0.log" Jun 02 01:42:11.715208 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:11.715179 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-wqngw_ca0d1790-d9a5-47ad-9efb-bb3841d49b09/manager/0.log" Jun 02 01:42:12.061355 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:12.061275 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n_b2c87e14-e92c-4476-a6a6-1d111c18a0b1/istio-proxy/0.log" Jun 02 01:42:12.518133 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:12.518103 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-h7t2f_1c82baf2-514a-4665-b8cb-dea2d5e063a9/istio-proxy/0.log" Jun 02 01:42:13.208054 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:13.208023 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk_d394e32f-a390-46bc-a2a0-666cb211a536/storage-initializer/0.log" Jun 02 01:42:13.215998 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:13.215979 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-l9mdk_d394e32f-a390-46bc-a2a0-666cb211a536/main/0.log" Jun 02 01:42:17.861702 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:17.861666 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-524c7/must-gather-tg2kh"] Jun 02 01:42:17.865299 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:17.865282 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:17.867715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:17.867686 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-524c7\"/\"kube-root-ca.crt\"" Jun 02 01:42:17.868559 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:17.868539 2609 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-524c7\"/\"openshift-service-ca.crt\"" Jun 02 01:42:17.868662 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:17.868556 2609 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-524c7\"/\"default-dockercfg-45n7s\"" Jun 02 01:42:17.878271 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:17.878250 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-524c7/must-gather-tg2kh"] Jun 02 01:42:18.025296 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.025261 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61727130-7c09-440b-816f-ffceb2ca062d-must-gather-output\") pod \"must-gather-tg2kh\" (UID: \"61727130-7c09-440b-816f-ffceb2ca062d\") " pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:18.025488 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.025432 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdm7n\" (UniqueName: \"kubernetes.io/projected/61727130-7c09-440b-816f-ffceb2ca062d-kube-api-access-vdm7n\") pod \"must-gather-tg2kh\" (UID: \"61727130-7c09-440b-816f-ffceb2ca062d\") " pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:18.126555 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.126448 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdm7n\" (UniqueName: \"kubernetes.io/projected/61727130-7c09-440b-816f-ffceb2ca062d-kube-api-access-vdm7n\") pod \"must-gather-tg2kh\" (UID: \"61727130-7c09-440b-816f-ffceb2ca062d\") " pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:18.126555 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.126496 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61727130-7c09-440b-816f-ffceb2ca062d-must-gather-output\") pod \"must-gather-tg2kh\" (UID: \"61727130-7c09-440b-816f-ffceb2ca062d\") " pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:18.126863 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.126840 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61727130-7c09-440b-816f-ffceb2ca062d-must-gather-output\") pod \"must-gather-tg2kh\" (UID: \"61727130-7c09-440b-816f-ffceb2ca062d\") " pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:18.133997 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.133973 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdm7n\" (UniqueName: \"kubernetes.io/projected/61727130-7c09-440b-816f-ffceb2ca062d-kube-api-access-vdm7n\") pod \"must-gather-tg2kh\" (UID: \"61727130-7c09-440b-816f-ffceb2ca062d\") " pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:18.175036 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.175013 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-524c7/must-gather-tg2kh" Jun 02 01:42:18.310458 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.310429 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-524c7/must-gather-tg2kh"] Jun 02 01:42:18.312041 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:42:18.312009 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61727130_7c09_440b_816f_ffceb2ca062d.slice/crio-f0752268d7f31c782295ae965ad7894de7d46255ab025f0cdd1795288318af0b WatchSource:0}: Error finding container f0752268d7f31c782295ae965ad7894de7d46255ab025f0cdd1795288318af0b: Status 404 returned error can't find the container with id f0752268d7f31c782295ae965ad7894de7d46255ab025f0cdd1795288318af0b Jun 02 01:42:18.313802 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.313784 2609 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:42:18.589810 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:18.589776 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-524c7/must-gather-tg2kh" event={"ID":"61727130-7c09-440b-816f-ffceb2ca062d","Type":"ContainerStarted","Data":"f0752268d7f31c782295ae965ad7894de7d46255ab025f0cdd1795288318af0b"} Jun 02 01:42:19.596503 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:19.596469 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-524c7/must-gather-tg2kh" event={"ID":"61727130-7c09-440b-816f-ffceb2ca062d","Type":"ContainerStarted","Data":"86d0333f5ae96d8a3febe4b7cb7671841d5ec14a0019554eebb3f74823a3c4b2"} Jun 02 01:42:19.596909 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:19.596513 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-524c7/must-gather-tg2kh" event={"ID":"61727130-7c09-440b-816f-ffceb2ca062d","Type":"ContainerStarted","Data":"bcea8bdb07ea52f83b28d0ce078e489fa66c3139abf5b190d786309bacbbd369"} Jun 02 01:42:19.612518 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:19.612470 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-524c7/must-gather-tg2kh" podStartSLOduration=1.786959782 podStartE2EDuration="2.612455511s" podCreationTimestamp="2026-06-02 01:42:17 +0000 UTC" firstStartedPulling="2026-06-02 01:42:18.313920681 +0000 UTC m=+1166.008842961" lastFinishedPulling="2026-06-02 01:42:19.139416407 +0000 UTC m=+1166.834338690" observedRunningTime="2026-06-02 01:42:19.610487397 +0000 UTC m=+1167.305409698" watchObservedRunningTime="2026-06-02 01:42:19.612455511 +0000 UTC m=+1167.307377828" Jun 02 01:42:20.890697 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:20.890652 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5zh6l_02122a14-5e0b-464b-a926-8b1315b02b0a/global-pull-secret-syncer/0.log" Jun 02 01:42:21.019625 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:21.019590 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vl5k9_53dde8e3-30f1-4d96-bf55-9125732564d0/konnectivity-agent/0.log" Jun 02 01:42:21.229286 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:21.229251 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-112.ec2.internal_03a83b4ff4fc8afcd2787035eae18187/haproxy/0.log" Jun 02 01:42:25.082399 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.082369 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6_e9d800de-a142-4026-be95-d3afa173cb37/extract/0.log" Jun 02 01:42:25.106632 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.106608 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6_e9d800de-a142-4026-be95-d3afa173cb37/util/0.log" Jun 02 01:42:25.129419 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.129393 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759fdvp6_e9d800de-a142-4026-be95-d3afa173cb37/pull/0.log" Jun 02 01:42:25.154055 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.154020 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7_b2f54f8d-e376-40ab-9410-dd2ad6ab49b0/extract/0.log" Jun 02 01:42:25.177103 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.177070 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7_b2f54f8d-e376-40ab-9410-dd2ad6ab49b0/util/0.log" Jun 02 01:42:25.198101 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.198051 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0mdcg7_b2f54f8d-e376-40ab-9410-dd2ad6ab49b0/pull/0.log" Jun 02 01:42:25.226028 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.226002 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw_cacdd264-db08-4fdf-ba33-3c29da02dd2a/extract/0.log" Jun 02 01:42:25.246824 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.246790 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw_cacdd264-db08-4fdf-ba33-3c29da02dd2a/util/0.log" Jun 02 01:42:25.269668 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.269634 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hp9cw_cacdd264-db08-4fdf-ba33-3c29da02dd2a/pull/0.log" Jun 02 01:42:25.303367 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.303330 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c_81e0303c-2ec1-4ea0-8145-8b6e2b2a276d/extract/0.log" Jun 02 01:42:25.321414 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.321382 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c_81e0303c-2ec1-4ea0-8145-8b6e2b2a276d/util/0.log" Jun 02 01:42:25.344053 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.343979 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wvp5c_81e0303c-2ec1-4ea0-8145-8b6e2b2a276d/pull/0.log" Jun 02 01:42:25.399792 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.399758 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-lnhr5_faeb1c35-8360-478e-81c5-6e5e7d5d2a69/manager/0.log" Jun 02 01:42:25.422119 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.422086 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-258fg_ac3ec1bf-ee21-4f0e-bfdf-93c1983793aa/manager/0.log" Jun 02 01:42:25.482796 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.482763 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mggsr_fe3da251-e829-41d2-9dce-ab560b114834/registry-server/0.log" Jun 02 01:42:25.574577 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:25.574545 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-wqngw_ca0d1790-d9a5-47ad-9efb-bb3841d49b09/manager/0.log" Jun 02 01:42:26.820548 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:26.819889 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/alertmanager/0.log" Jun 02 01:42:26.843749 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:26.843713 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/config-reloader/0.log" Jun 02 01:42:26.862685 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:26.862660 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/kube-rbac-proxy-web/0.log" Jun 02 01:42:26.882055 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:26.881957 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/kube-rbac-proxy/0.log" Jun 02 01:42:26.903362 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:26.903321 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/kube-rbac-proxy-metric/0.log" Jun 02 01:42:26.937306 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:26.936969 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/prom-label-proxy/0.log" Jun 02 01:42:26.961786 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:26.961759 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_c3bd2dec-8fd0-48b1-90f1-cfcdeaf6555f/init-config-reloader/0.log" Jun 02 01:42:27.160801 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.160772 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtbtr_5ef311fe-5c0c-4702-b86b-bec07f9c701b/node-exporter/0.log" Jun 02 01:42:27.197688 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.197660 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtbtr_5ef311fe-5c0c-4702-b86b-bec07f9c701b/kube-rbac-proxy/0.log" Jun 02 01:42:27.234593 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.234537 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dtbtr_5ef311fe-5c0c-4702-b86b-bec07f9c701b/init-textfile/0.log" Jun 02 01:42:27.459119 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.459069 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-8xk8r_9dc42d67-ab2c-445a-b575-072e97f36bb4/kube-rbac-proxy-main/0.log" Jun 02 01:42:27.482486 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.482454 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-8xk8r_9dc42d67-ab2c-445a-b575-072e97f36bb4/kube-rbac-proxy-self/0.log" Jun 02 01:42:27.501759 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.501733 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-8xk8r_9dc42d67-ab2c-445a-b575-072e97f36bb4/openshift-state-metrics/0.log" Jun 02 01:42:27.687410 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.687378 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-zkwhb_f17b27c0-9e47-439a-94e0-307d46be6ca1/prometheus-operator/0.log" Jun 02 01:42:27.712798 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.712721 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-zkwhb_f17b27c0-9e47-439a-94e0-307d46be6ca1/kube-rbac-proxy/0.log" Jun 02 01:42:27.739804 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.739771 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-zrvzb_001edd65-ef3a-4c3b-bb94-61b4bc978914/prometheus-operator-admission-webhook/0.log" Jun 02 01:42:27.769207 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.769146 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f97cf7796-9khh5_420a26e0-508d-4bf3-9664-4bb92684d523/telemeter-client/0.log" Jun 02 01:42:27.790427 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.790388 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f97cf7796-9khh5_420a26e0-508d-4bf3-9664-4bb92684d523/reload/0.log" Jun 02 01:42:27.818430 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:27.818398 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f97cf7796-9khh5_420a26e0-508d-4bf3-9664-4bb92684d523/kube-rbac-proxy/0.log" Jun 02 01:42:29.624945 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:29.624909 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/1.log" Jun 02 01:42:29.634182 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:29.634147 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-85f4s_b36740ed-c338-43c2-a469-a9b3863700d8/console-operator/2.log" Jun 02 01:42:30.104621 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.104588 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b7f4f8cd6-sp6d9_d154cc93-3da2-4f1b-a579-06c303e6364d/console/0.log" Jun 02 01:42:30.477379 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.477337 2609 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw"] Jun 02 01:42:30.485508 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.485471 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.490446 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.490418 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw"] Jun 02 01:42:30.568290 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.568250 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-proc\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.568486 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.568310 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-podres\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.568486 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.568479 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-lib-modules\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.568639 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.568513 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk8gk\" (UniqueName: \"kubernetes.io/projected/a018a23c-4a2e-4f70-9bcb-714b59d385b8-kube-api-access-qk8gk\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.568700 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.568636 2609 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-sys\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.669602 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.669569 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-lib-modules\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670142 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.669850 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-lib-modules\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670142 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.670127 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk8gk\" (UniqueName: \"kubernetes.io/projected/a018a23c-4a2e-4f70-9bcb-714b59d385b8-kube-api-access-qk8gk\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.670190 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-sys\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.670230 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-proc\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670297 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.670262 2609 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-podres\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670818 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.670469 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-podres\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670818 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.670492 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-sys\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.670818 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.670540 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a018a23c-4a2e-4f70-9bcb-714b59d385b8-proc\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.678988 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.678967 2609 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk8gk\" (UniqueName: \"kubernetes.io/projected/a018a23c-4a2e-4f70-9bcb-714b59d385b8-kube-api-access-qk8gk\") pod \"perf-node-gather-daemonset-jnqjw\" (UID: \"a018a23c-4a2e-4f70-9bcb-714b59d385b8\") " pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.705251 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.705225 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-fl6z6_ae879d0a-dc8a-43a4-a764-bd6bf873eaf0/volume-data-source-validator/0.log" Jun 02 01:42:30.800731 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.800643 2609 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:30.975453 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:30.975422 2609 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw"] Jun 02 01:42:30.975911 ip-10-0-140-112 kubenswrapper[2609]: W0602 01:42:30.975886 2609 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda018a23c_4a2e_4f70_9bcb_714b59d385b8.slice/crio-587dda7fa642cdb0cdca20cf31248d556b6ced9d5170c3d826a2a3f27664c08a WatchSource:0}: Error finding container 587dda7fa642cdb0cdca20cf31248d556b6ced9d5170c3d826a2a3f27664c08a: Status 404 returned error can't find the container with id 587dda7fa642cdb0cdca20cf31248d556b6ced9d5170c3d826a2a3f27664c08a Jun 02 01:42:31.619928 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:31.619902 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vz56r_c2eeaf9f-12dd-4ed2-925b-bc327f84fb54/dns/0.log" Jun 02 01:42:31.642397 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:31.642365 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vz56r_c2eeaf9f-12dd-4ed2-925b-bc327f84fb54/kube-rbac-proxy/0.log" Jun 02 01:42:31.662476 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:31.662402 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" event={"ID":"a018a23c-4a2e-4f70-9bcb-714b59d385b8","Type":"ContainerStarted","Data":"1d0fd20c1839734fe7e2eb49b43e2e56125f089ec1cc7843b6716e9a56fc910d"} Jun 02 01:42:31.662476 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:31.662442 2609 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" event={"ID":"a018a23c-4a2e-4f70-9bcb-714b59d385b8","Type":"ContainerStarted","Data":"587dda7fa642cdb0cdca20cf31248d556b6ced9d5170c3d826a2a3f27664c08a"} Jun 02 01:42:31.662738 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:31.662568 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:31.680500 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:31.680457 2609 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" podStartSLOduration=1.680444473 podStartE2EDuration="1.680444473s" podCreationTimestamp="2026-06-02 01:42:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:42:31.676486769 +0000 UTC m=+1179.371409249" watchObservedRunningTime="2026-06-02 01:42:31.680444473 +0000 UTC m=+1179.375366775" Jun 02 01:42:31.691940 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:31.691916 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h7skf_34271d8f-db17-455f-a495-36c129fa4e43/dns-node-resolver/0.log" Jun 02 01:42:32.199056 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:32.199016 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m9xgw_9de0bb29-7de6-4b0b-9c7e-882f9b79b4a1/node-ca/0.log" Jun 02 01:42:32.991102 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:32.991055 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bbvf6n_b2c87e14-e92c-4476-a6a6-1d111c18a0b1/istio-proxy/0.log" Jun 02 01:42:33.126410 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:33.126379 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-h7t2f_1c82baf2-514a-4665-b8cb-dea2d5e063a9/istio-proxy/0.log" Jun 02 01:42:33.694417 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:33.694391 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r8gwk_60bd9749-f749-411f-bd85-6c73d2dfe4ed/serve-healthcheck-canary/0.log" Jun 02 01:42:34.149098 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:34.148991 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-96x9s_370bb775-0ebd-495e-b42e-d92a9c89c419/insights-operator/0.log" Jun 02 01:42:34.151874 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:34.151849 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-96x9s_370bb775-0ebd-495e-b42e-d92a9c89c419/insights-operator/1.log" Jun 02 01:42:34.241569 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:34.241548 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2tjs_26b6de66-dd09-47f8-82fb-53bd63dd9622/kube-rbac-proxy/0.log" Jun 02 01:42:34.260316 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:34.260275 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2tjs_26b6de66-dd09-47f8-82fb-53bd63dd9622/exporter/0.log" Jun 02 01:42:34.279356 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:34.279332 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h2tjs_26b6de66-dd09-47f8-82fb-53bd63dd9622/extractor/0.log" Jun 02 01:42:36.347644 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:36.347612 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7598c6c7c5-kgdsj_cca0008d-1f02-42c8-8de0-fb6668c94d4d/nginx/0.log" Jun 02 01:42:36.528694 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:36.528659 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-5kjfm_a76468f8-101c-4354-aa6c-2294a0491e2e/manager/0.log" Jun 02 01:42:36.546121 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:36.546100 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6758f7c588-5kjfm_a76468f8-101c-4354-aa6c-2294a0491e2e/copy-manifests/0.log" Jun 02 01:42:37.678667 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:37.678642 2609 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-524c7/perf-node-gather-daemonset-jnqjw" Jun 02 01:42:37.950275 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:37.950196 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6df7964bff-lrllk_29afc0cf-e57f-4823-b96f-3df958da764e/manager/0.log" Jun 02 01:42:42.698295 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:42.698262 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-x2szl_b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a/migrator/0.log" Jun 02 01:42:42.718690 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:42.718650 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-x2szl_b4a58663-a2ea-4b1e-8f9e-9a5ffec12c0a/graceful-termination/0.log" Jun 02 01:42:43.059107 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:43.059017 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-df7v8_81be2234-eadc-4bd8-bc01-0b21cdba80cc/kube-storage-version-migrator-operator/1.log" Jun 02 01:42:43.060689 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:43.060661 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-df7v8_81be2234-eadc-4bd8-bc01-0b21cdba80cc/kube-storage-version-migrator-operator/0.log" Jun 02 01:42:44.063088 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.063059 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7w4k5_8c3afb8b-6c0c-43bb-96e1-998fb2f9f95a/kube-multus/0.log" Jun 02 01:42:44.229869 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.229842 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lw54v_a4f343ec-b5d8-4641-84ed-2dc2d37ad4df/kube-multus-additional-cni-plugins/0.log" Jun 02 01:42:44.251331 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.251305 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lw54v_a4f343ec-b5d8-4641-84ed-2dc2d37ad4df/egress-router-binary-copy/0.log" Jun 02 01:42:44.268852 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.268832 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lw54v_a4f343ec-b5d8-4641-84ed-2dc2d37ad4df/cni-plugins/0.log" Jun 02 01:42:44.287480 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.287460 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lw54v_a4f343ec-b5d8-4641-84ed-2dc2d37ad4df/bond-cni-plugin/0.log" Jun 02 01:42:44.306706 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.306686 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lw54v_a4f343ec-b5d8-4641-84ed-2dc2d37ad4df/routeoverride-cni/0.log" Jun 02 01:42:44.325948 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.325885 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lw54v_a4f343ec-b5d8-4641-84ed-2dc2d37ad4df/whereabouts-cni-bincopy/0.log" Jun 02 01:42:44.344583 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.344559 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lw54v_a4f343ec-b5d8-4641-84ed-2dc2d37ad4df/whereabouts-cni/0.log" Jun 02 01:42:44.577134 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.577059 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w9s4l_c24605d8-ee39-4c34-a643-e2fca2ffa4ed/network-metrics-daemon/0.log" Jun 02 01:42:44.592933 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:44.592909 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w9s4l_c24605d8-ee39-4c34-a643-e2fca2ffa4ed/kube-rbac-proxy/0.log" Jun 02 01:42:45.903349 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:45.903322 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-controller/0.log" Jun 02 01:42:45.920008 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:45.919985 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/0.log" Jun 02 01:42:45.930776 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:45.930753 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovn-acl-logging/1.log" Jun 02 01:42:45.950877 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:45.950856 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/kube-rbac-proxy-node/0.log" Jun 02 01:42:45.973250 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:45.973204 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 01:42:45.989715 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:45.989682 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/northd/0.log" Jun 02 01:42:46.007615 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:46.007592 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/nbdb/0.log" Jun 02 01:42:46.027965 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:46.027935 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/sbdb/0.log" Jun 02 01:42:46.224075 ip-10-0-140-112 kubenswrapper[2609]: I0602 01:42:46.224042 2609 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ttt5v_f3a241f1-218e-46fa-8d39-62513637c9c5/ovnkube-controller/0.log"