Jul 21 02:09:25.616526 ip-10-0-137-128 systemd[1]: Starting Kubernetes Kubelet... Jul 21 02:09:27.862355 ip-10-0-137-128 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 02:09:27.862355 ip-10-0-137-128 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 02:09:27.862355 ip-10-0-137-128 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 02:09:27.862355 ip-10-0-137-128 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 02:09:27.862355 ip-10-0-137-128 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 02:09:27.864729 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.864632 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 02:09:27.868855 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868832 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 02:09:27.868855 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868852 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 02:09:27.868855 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868857 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 02:09:27.868855 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868861 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868865 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868869 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868873 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868876 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868880 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868884 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868889 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868892 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868895 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868899 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868903 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868906 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868910 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868918 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868922 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868926 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868930 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868934 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 02:09:27.869097 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868937 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868941 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868944 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868948 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868952 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868956 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868960 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868964 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868968 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868971 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868975 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868979 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868982 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868986 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868990 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.868995 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869000 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869004 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869009 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869013 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869018 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 02:09:27.869677 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869023 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869027 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869031 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869036 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869040 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869045 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869049 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869053 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869057 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869061 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869066 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869070 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869074 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869080 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869084 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869088 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869092 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869096 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869100 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869104 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 02:09:27.870198 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869108 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869114 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869118 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869122 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869127 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869131 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869138 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869143 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869147 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869151 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869155 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869159 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869164 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869168 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869172 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869176 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869180 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869184 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869193 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 02:09:27.870683 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869199 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869204 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869209 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869213 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869218 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869223 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869228 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869233 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869237 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869244 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869251 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869273 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869278 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869282 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869289 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869297 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 02:09:27.871329 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.869302 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 02:09:27.872066 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872049 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 02:09:27.872066 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872067 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872073 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872078 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872082 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872086 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872090 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872094 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872100 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872104 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872108 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872111 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872115 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872119 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872123 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872127 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872132 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872135 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872140 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872144 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872148 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 02:09:27.872165 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872152 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872157 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872160 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872164 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872171 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872177 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872181 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872185 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872190 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872194 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872201 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872205 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872209 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872213 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872217 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872221 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872225 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872230 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872234 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872238 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 02:09:27.872992 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872242 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872246 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872250 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872269 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872274 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872278 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872281 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872286 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872290 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872294 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872298 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872302 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872306 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872309 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872315 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872319 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872323 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872327 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872332 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872336 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 02:09:27.873818 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872340 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872344 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872351 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872358 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872363 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872368 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872372 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872376 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872380 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872384 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872389 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872393 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872397 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872401 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872405 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872409 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872413 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872419 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872423 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 02:09:27.874654 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872427 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872431 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872435 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872439 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872443 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872447 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872452 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872456 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872460 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872464 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872468 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872472 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872476 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872481 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872485 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872490 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872496 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872502 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.872507 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873143 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 02:09:27.875347 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873152 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873157 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873162 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873166 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873170 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873174 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873178 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873184 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873188 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873193 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873197 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873200 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873205 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873209 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873213 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873217 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873221 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873226 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873230 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873234 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 02:09:27.875858 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873238 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873242 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873245 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873250 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873271 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873276 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873280 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873284 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873288 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873293 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873297 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873301 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873305 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873309 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873314 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873318 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873322 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873326 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873330 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873335 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 02:09:27.876427 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873339 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873343 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873347 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873351 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873355 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873359 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873363 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873367 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873371 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873376 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873380 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873384 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873388 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873392 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873396 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873401 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873405 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873412 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873417 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 02:09:27.877070 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873421 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873426 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873430 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873436 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873441 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873445 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873451 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873457 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873461 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873466 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873473 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873477 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873482 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873486 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873490 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873494 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873498 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873502 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873506 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 02:09:27.877571 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873514 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873519 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873524 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873529 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873534 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873538 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873542 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873546 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873550 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873554 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873558 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873562 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873566 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873570 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873574 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873578 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873582 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873587 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873591 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.873595 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873705 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 02:09:27.878048 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873716 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873726 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873736 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873742 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873747 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873754 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873761 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873766 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873771 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873777 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873782 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873787 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873792 2565 flags.go:64] FLAG: --cgroup-root="" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873797 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873802 2565 flags.go:64] FLAG: --client-ca-file="" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873806 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873811 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873817 2565 flags.go:64] FLAG: --cluster-domain="" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873821 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873826 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873831 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873836 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873841 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 02:09:27.878637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873846 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873851 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873856 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873861 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873866 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873871 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873877 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873882 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873888 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873893 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873897 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873904 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873909 2565 flags.go:64] FLAG: --enable-server="true" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873916 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873923 2565 flags.go:64] FLAG: --event-burst="100" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873928 2565 flags.go:64] FLAG: --event-qps="50" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873933 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873938 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873943 2565 flags.go:64] FLAG: --eviction-hard="" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873948 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873953 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873958 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873962 2565 flags.go:64] FLAG: --eviction-soft="" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873967 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873972 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 02:09:27.879179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873977 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873981 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873986 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873990 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.873995 2565 flags.go:64] FLAG: --feature-gates="" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874001 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874006 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874011 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874016 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874020 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874025 2565 flags.go:64] FLAG: --help="false" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874029 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-137-128.ec2.internal" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874034 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874039 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874044 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874050 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874055 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874060 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874066 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874070 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874076 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874081 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874086 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874091 2565 flags.go:64] FLAG: --kube-reserved="" Jul 21 02:09:27.879797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874095 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874100 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874105 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874109 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874114 2565 flags.go:64] FLAG: --lock-file="" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874118 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874123 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874128 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874136 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874141 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874145 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874150 2565 flags.go:64] FLAG: --logging-format="text" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874154 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874159 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874164 2565 flags.go:64] FLAG: --manifest-url="" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874168 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874175 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874180 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874186 2565 flags.go:64] FLAG: --max-pods="110" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874191 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874196 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874200 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874205 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874210 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874215 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 02:09:27.880394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874220 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874235 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874241 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874247 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874270 2565 flags.go:64] FLAG: --pod-cidr="" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874276 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874285 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874289 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874294 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874298 2565 flags.go:64] FLAG: --port="10250" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874303 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874308 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a67bb4d46947dc4" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874313 2565 flags.go:64] FLAG: --qos-reserved="" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874318 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874323 2565 flags.go:64] FLAG: --register-node="true" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874327 2565 flags.go:64] FLAG: --register-with-taints="" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874334 2565 flags.go:64] FLAG: --registry-burst="10" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874338 2565 flags.go:64] FLAG: --registry-qps="5" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874342 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874347 2565 flags.go:64] FLAG: --reserved-memory="" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874354 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874359 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874363 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874368 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874372 2565 flags.go:64] FLAG: --runonce="false" Jul 21 02:09:27.880985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874377 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874382 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874387 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874392 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874397 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874402 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874407 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874412 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874417 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874424 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874430 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874435 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874440 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874445 2565 flags.go:64] FLAG: --system-cgroups="" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874449 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874458 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874463 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874468 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874474 2565 flags.go:64] FLAG: --tls-min-version="" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874479 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874483 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874488 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874493 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874497 2565 flags.go:64] FLAG: --v="2" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874504 2565 flags.go:64] FLAG: --version="false" Jul 21 02:09:27.881691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874510 2565 flags.go:64] FLAG: --vmodule="" Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874517 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.874522 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874706 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874713 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874717 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874722 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874726 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874730 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874735 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874739 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874743 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874747 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874751 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874756 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874761 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874767 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874773 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874777 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 02:09:27.882298 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874782 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874786 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874790 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874794 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874798 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874802 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874807 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874811 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874815 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874819 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874823 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874827 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874831 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874836 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874840 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874844 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874847 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874852 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874856 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874860 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 02:09:27.882853 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874864 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874868 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874872 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874876 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874880 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874884 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874889 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874893 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874907 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874912 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874918 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874922 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874926 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874930 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874934 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874938 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874942 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874946 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874950 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874954 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 02:09:27.883352 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874959 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874963 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874967 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874972 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874976 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874981 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874985 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874989 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874993 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.874997 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875001 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875006 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875009 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875013 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875017 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875021 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875025 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875029 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875033 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875037 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 02:09:27.883802 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875041 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875048 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875055 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875059 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875063 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875070 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875076 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875081 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875086 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875091 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875095 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875100 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875105 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875110 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875114 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875118 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875122 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875126 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875133 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 02:09:27.884280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875139 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875145 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875150 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.875155 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.875792 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.883138 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.883155 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.883950 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.883958 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884036 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884041 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884045 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884049 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 02:09:27.884727 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884051 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884060 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884063 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884065 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884068 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884071 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884073 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884076 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884078 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884081 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884084 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884086 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884088 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884092 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884096 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884099 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884103 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884107 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884110 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 02:09:27.885040 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884112 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884115 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884118 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884121 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884124 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884127 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884130 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884133 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884135 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884138 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884140 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884143 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884146 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884148 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884151 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884159 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884161 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884164 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884168 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 02:09:27.885591 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884171 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884173 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884176 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884179 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884181 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884184 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884187 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884189 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884192 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884194 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884197 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884199 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884201 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884204 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884206 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884209 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884212 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884214 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884218 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884220 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 02:09:27.886032 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884223 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884225 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884228 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884230 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884233 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884235 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884238 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884240 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884243 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884251 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884264 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884267 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884270 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884272 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884275 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884277 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884280 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884282 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884285 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884288 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884291 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 02:09:27.886503 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884294 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884296 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884299 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884302 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884304 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884307 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884310 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884312 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884315 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884317 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884320 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884323 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884325 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884328 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884331 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 02:09:27.887025 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884333 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.884339 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884487 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884492 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884495 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884498 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884506 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884509 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884511 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884514 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884516 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884519 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884521 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884524 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884526 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 02:09:27.887391 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884528 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884531 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884533 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884535 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884539 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884542 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884545 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884548 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884551 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884554 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884556 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884560 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884563 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884566 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884569 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884571 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884573 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884576 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884579 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 02:09:27.887748 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884581 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884584 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884586 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884589 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884591 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884601 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884603 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884606 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884608 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884610 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884613 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884615 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884617 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884621 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884625 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884627 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884630 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884633 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884637 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884639 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 02:09:27.888482 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884642 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884645 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884647 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884649 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884652 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884654 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884656 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884659 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884661 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884664 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884667 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884669 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884672 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884674 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884677 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884679 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884681 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884684 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884692 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884694 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 02:09:27.889174 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884697 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884699 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884702 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884704 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884707 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884709 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884711 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884714 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884716 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884718 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884721 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884724 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884726 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884729 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884732 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884734 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884737 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884739 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884742 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 02:09:27.889816 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884744 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884746 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884751 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884754 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884756 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884758 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884761 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:27.884763 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.884768 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.884910 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 02:09:27.890280 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.888953 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 02:09:27.890580 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.890428 2565 server.go:1019] "Starting client certificate rotation" Jul 21 02:09:27.890580 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.890526 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 02:09:27.890580 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.890563 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 02:09:27.894729 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.894710 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 02:09:27.898642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.898623 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 02:09:27.911854 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.911830 2565 log.go:25] "Validated CRI v1 runtime API" Jul 21 02:09:27.914053 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.914038 2565 log.go:25] "Validated CRI v1 image API" Jul 21 02:09:27.914841 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.914825 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 02:09:27.917325 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.917297 2565 fs.go:135] Filesystem UUIDs: map[3dc25bf6-bf73-4ed1-a570-4d98aa011f1a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 cfbb63ee-0fe5-44e4-97d1-be03b1ae89f3:/dev/nvme0n1p4] Jul 21 02:09:27.917325 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.917318 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 02:09:27.922695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.922574 2565 manager.go:216] Machine: {Timestamp:2026-07-21 02:09:27.920899831 +0000 UTC m=+0.843578940 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3209191 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec265a42db3812a6705c0ef83359a598 SystemUUID:ec265a42-db38-12a6-705c-0ef83359a598 BootID:db42a628-4a86-41b8-b2c2-89c6686ea7f9 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:51:a0:b9:4f:a1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:51:a0:b9:4f:a1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:98:3b:bc:00:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 02:09:27.922695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.922679 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 02:09:27.922837 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.922807 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 02:09:27.923950 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.923935 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 02:09:27.926283 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.926242 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 02:09:27.926421 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.926287 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-128.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 02:09:27.927484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.927473 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 02:09:27.927521 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.927487 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 02:09:27.927521 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.927495 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 02:09:27.928162 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.928152 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 02:09:27.929419 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.929409 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 02:09:27.932528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.932517 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 21 02:09:27.932888 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.932863 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 02:09:27.932976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.932915 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 21 02:09:27.932976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.932930 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 02:09:27.932976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.932954 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 02:09:27.932976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.932968 2565 kubelet.go:398] "Adding apiserver pod source" Jul 21 02:09:27.933141 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.932981 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 02:09:27.933715 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.933473 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 02:09:27.933715 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.933509 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 02:09:27.935785 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.935764 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 02:09:27.937788 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.937774 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 02:09:27.937848 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.937803 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 02:09:27.939115 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939104 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 02:09:27.939157 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939119 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 02:09:27.939157 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939125 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 02:09:27.939157 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939131 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 02:09:27.939157 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939139 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 02:09:27.939157 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939144 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 02:09:27.939157 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939153 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 02:09:27.939157 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939158 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 02:09:27.939357 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939165 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 02:09:27.939357 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939170 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 02:09:27.939357 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939178 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 02:09:27.939357 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.939183 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 02:09:27.940780 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.940768 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 02:09:27.940815 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.940781 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 02:09:27.944188 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.944175 2565 server.go:1268] "Started kubelet" Jul 21 02:09:27.944389 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.944351 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 02:09:27.944487 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.944330 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 02:09:27.944487 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.944446 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 02:09:27.945087 ip-10-0-137-128 systemd[1]: Started Kubernetes Kubelet. Jul 21 02:09:27.945950 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.945936 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-128.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 02:09:27.946275 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.946243 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 02:09:27.946460 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.946441 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 21 02:09:27.947121 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.947096 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 02:09:27.947121 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.947098 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 02:09:27.950066 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.950049 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 02:09:27.951699 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.950847 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-128.ec2.internal.18c42c08a28e3719 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-128.ec2.internal,UID:ip-10-0-137-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-128.ec2.internal,},FirstTimestamp:2026-07-21 02:09:27.944148761 +0000 UTC m=+0.866827858,LastTimestamp:2026-07-21 02:09:27.944148761 +0000 UTC m=+0.866827858,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-128.ec2.internal,}" Jul 21 02:09:27.952887 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.952865 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 02:09:27.952887 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.952884 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 02:09:27.953055 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.953037 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:27.953717 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.953698 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 02:09:27.953717 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.953697 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 02:09:27.953849 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.953731 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 02:09:27.953892 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.953869 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 21 02:09:27.953892 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.953888 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 21 02:09:27.953976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.953921 2565 factory.go:55] Registering systemd factory Jul 21 02:09:27.953976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.953959 2565 factory.go:223] Registration of the systemd container factory successfully Jul 21 02:09:27.954190 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.954174 2565 factory.go:153] Registering CRI-O factory Jul 21 02:09:27.954190 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.954191 2565 factory.go:223] Registration of the crio container factory successfully Jul 21 02:09:27.954340 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.954234 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 02:09:27.954340 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.954286 2565 factory.go:103] Registering Raw factory Jul 21 02:09:27.954340 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.954307 2565 manager.go:1196] Started watching for new ooms in manager Jul 21 02:09:27.954755 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.954742 2565 manager.go:349] Starting recovery of all containers Jul 21 02:09:27.960502 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.958173 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 02:09:27.960502 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.958305 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-128.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 02:09:27.966645 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.966628 2565 manager.go:354] Recovery completed Jul 21 02:09:27.971303 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.971289 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 02:09:27.973203 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973183 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientMemory" Jul 21 02:09:27.973287 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973217 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 02:09:27.973287 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973228 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientPID" Jul 21 02:09:27.973679 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973662 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q5xl2" Jul 21 02:09:27.973904 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973893 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 02:09:27.973944 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973903 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 02:09:27.973944 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973917 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 21 02:09:27.974033 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.973964 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 02:09:27.974678 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.974660 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientMemory" Jul 21 02:09:27.974748 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.974690 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 02:09:27.974748 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.974703 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientPID" Jul 21 02:09:27.975179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.975167 2565 policy_none.go:49] "None policy: Start" Jul 21 02:09:27.975212 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.975184 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 02:09:27.975212 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.975196 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 02:09:27.975560 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.975492 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-128.ec2.internal.18c42c08a44988c1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-128.ec2.internal,UID:ip-10-0-137-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-128.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-128.ec2.internal,},FirstTimestamp:2026-07-21 02:09:27.973202113 +0000 UTC m=+0.895881213,LastTimestamp:2026-07-21 02:09:27.973202113 +0000 UTC m=+0.895881213,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-128.ec2.internal,}" Jul 21 02:09:27.976131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.976120 2565 policy_none.go:47] "Start" Jul 21 02:09:27.983054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:27.983037 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q5xl2" Jul 21 02:09:27.984340 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:27.984273 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-128.ec2.internal.18c42c08a449d8f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-128.ec2.internal,UID:ip-10-0-137-128.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-128.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-128.ec2.internal,},FirstTimestamp:2026-07-21 02:09:27.973222641 +0000 UTC m=+0.895901739,LastTimestamp:2026-07-21 02:09:27.973222641 +0000 UTC m=+0.895901739,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-128.ec2.internal,}" Jul 21 02:09:28.009898 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.009878 2565 manager.go:337] "Starting Device Plugin manager" Jul 21 02:09:28.010034 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.009917 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 02:09:28.010034 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.009930 2565 server.go:87] "Starting device plugin registration server" Jul 21 02:09:28.010225 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.010212 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 02:09:28.010336 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.010228 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 02:09:28.010416 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.010399 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 02:09:28.010499 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.010487 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 02:09:28.010499 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.010499 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 02:09:28.011036 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.011012 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 02:09:28.011126 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.011061 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.110772 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.110735 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 02:09:28.112602 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.112547 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientMemory" Jul 21 02:09:28.112602 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.112585 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 02:09:28.112602 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.112599 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientPID" Jul 21 02:09:28.112850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.112630 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.118568 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.118534 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 02:09:28.119858 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.119840 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 02:09:28.119966 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.119882 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 02:09:28.119966 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.119905 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 02:09:28.119966 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.119944 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 02:09:28.122190 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.122172 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 02:09:28.122546 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.122533 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.122599 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.122553 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-128.ec2.internal\": node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.164227 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.164192 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.220603 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.220562 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal"] Jul 21 02:09:28.220754 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.220649 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 02:09:28.222600 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.222576 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientMemory" Jul 21 02:09:28.222706 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.222609 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 02:09:28.222706 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.222621 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientPID" Jul 21 02:09:28.223978 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.223965 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 02:09:28.224081 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.224120 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224107 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 02:09:28.224748 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224727 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientMemory" Jul 21 02:09:28.224840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224762 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 02:09:28.224840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224779 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientPID" Jul 21 02:09:28.224840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224782 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientMemory" Jul 21 02:09:28.224840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224801 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 02:09:28.224840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.224815 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientPID" Jul 21 02:09:28.225975 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.225960 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.226051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.225984 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 02:09:28.226677 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.226661 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientMemory" Jul 21 02:09:28.226758 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.226689 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 02:09:28.226758 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.226699 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeHasSufficientPID" Jul 21 02:09:28.250213 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.250183 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-128.ec2.internal\" not found" node="ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.255890 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.255866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b97019cada6ca6a03a3f478301c10efa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-128.ec2.internal\" (UID: \"b97019cada6ca6a03a3f478301c10efa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.255996 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.255895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/76dd8f90c35661213ff157ece2ab0348-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal\" (UID: \"76dd8f90c35661213ff157ece2ab0348\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.255996 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.255916 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76dd8f90c35661213ff157ece2ab0348-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal\" (UID: \"76dd8f90c35661213ff157ece2ab0348\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.256461 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.256445 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-128.ec2.internal\" not found" node="ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.264957 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.264937 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.356353 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.356158 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76dd8f90c35661213ff157ece2ab0348-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal\" (UID: \"76dd8f90c35661213ff157ece2ab0348\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.356539 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.356364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b97019cada6ca6a03a3f478301c10efa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-128.ec2.internal\" (UID: \"b97019cada6ca6a03a3f478301c10efa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.356539 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.356392 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/76dd8f90c35661213ff157ece2ab0348-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal\" (UID: \"76dd8f90c35661213ff157ece2ab0348\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.356539 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.356282 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76dd8f90c35661213ff157ece2ab0348-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal\" (UID: \"76dd8f90c35661213ff157ece2ab0348\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.356539 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.356436 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/76dd8f90c35661213ff157ece2ab0348-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal\" (UID: \"76dd8f90c35661213ff157ece2ab0348\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.356539 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.356463 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b97019cada6ca6a03a3f478301c10efa-config\") pod \"kube-apiserver-proxy-ip-10-0-137-128.ec2.internal\" (UID: \"b97019cada6ca6a03a3f478301c10efa\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.365358 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.365284 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.466059 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.466018 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.553277 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.553229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.559323 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.559296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.566961 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.566939 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.667586 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.667487 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.768065 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.768037 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-128.ec2.internal\" not found" Jul 21 02:09:28.779669 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.779652 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 02:09:28.853435 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.853413 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.864290 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.864248 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 02:09:28.866009 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.865995 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" Jul 21 02:09:28.882450 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.882423 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 02:09:28.889583 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.889560 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 02:09:28.889709 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.889690 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 02:09:28.934578 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.934495 2565 apiserver.go:52] "Watching apiserver" Jul 21 02:09:28.944704 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.944680 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 02:09:28.945081 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.945058 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-l46zf","openshift-image-registry/node-ca-24cm6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal","openshift-multus/multus-additional-cni-plugins-v4wk6","openshift-network-diagnostics/network-check-target-lm6kk","openshift-ovn-kubernetes/ovnkube-node-ncdpg","kube-system/konnectivity-agent-444p8","kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4","openshift-dns/node-resolver-zsfmr","openshift-multus/multus-wl8hl","openshift-multus/network-metrics-daemon-b94xm","openshift-network-operator/iptables-alerter-pg2b2","kube-system/global-pull-secret-syncer-dlvc8"] Jul 21 02:09:28.946625 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.946607 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.948398 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.948382 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:28.949484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.949467 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.950488 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.950467 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:28.950614 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.950553 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:28.950614 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.950571 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 02:09:28.950845 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.950832 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4mvn8\"" Jul 21 02:09:28.950888 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.950841 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:09:28.951655 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.951643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.952931 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.952913 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:28.953087 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.953069 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 02:09:28.954008 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.953992 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 02:09:28.954148 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.953992 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 02:09:28.954148 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.954062 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 02:09:28.954148 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.954067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.954446 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.954433 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kz6wr\"" Jul 21 02:09:28.955499 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.955484 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.957205 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.957217 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wl8hl" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.957362 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.957536 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.957835 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5ctmr\"" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.957868 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4mfn6\"" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958052 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958175 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 02:09:28.958243 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958240 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 02:09:28.958742 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958387 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 02:09:28.958742 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958676 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 02:09:28.958742 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958690 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-socket-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-systemd\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.958999 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959068 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-sys\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-var-lib-kubelet\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959157 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-var-lib-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959187 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovnkube-config\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5df84131-c0e2-4311-898d-577cbaa51e3c-konnectivity-ca\") pod \"konnectivity-agent-444p8\" (UID: \"5df84131-c0e2-4311-898d-577cbaa51e3c\") " pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-env-overrides\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysconfig\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.959443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-node-log\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-modprobe-d\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959548 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.959582 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxgl9\" (UniqueName: \"kubernetes.io/projected/9ac91b39-419c-442a-9a35-a5c2bb1b8198-kube-api-access-qxgl9\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-cni-bin\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovn-node-metrics-cert\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-registration-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959769 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-sys-fs\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-lib-modules\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-systemd\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959966 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vwf59\"" Jul 21 02:09:28.960075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.959981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-cni-netd\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-run\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960043 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-kubelet\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960125 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-system-cni-dir\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960150 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-cnibin\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960126 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-slash\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960290 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2v7s\" (UniqueName: \"kubernetes.io/projected/8cd7a337-6619-44d9-87e9-80231fa4f9ea-kube-api-access-t2v7s\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960324 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-os-release\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960356 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-run-netns\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960367 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m4xgl\"" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-log-socket\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960414 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-device-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960543 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmfm4\" (UniqueName: \"kubernetes.io/projected/3b13724b-8504-4175-b180-e8ecba075db0-kube-api-access-qmfm4\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960582 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960609 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-ovn\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.960691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysctl-conf\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-systemd-units\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960765 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960798 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d455697e-d0df-4cb5-b012-f9d13f779d14-host\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5df84131-c0e2-4311-898d-577cbaa51e3c-agent-certs\") pod \"konnectivity-agent-444p8\" (UID: \"5df84131-c0e2-4311-898d-577cbaa51e3c\") " pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960932 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kb5bp\"" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960950 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-host\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.960960 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961020 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-kubernetes\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961083 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961110 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ac91b39-419c-442a-9a35-a5c2bb1b8198-tmp\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktb9z\" (UniqueName: \"kubernetes.io/projected/f8069911-9c1d-4284-b705-2a8574c285e6-kube-api-access-ktb9z\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961242 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovnkube-script-lib\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2r8n\" (UniqueName: \"kubernetes.io/projected/d455697e-d0df-4cb5-b012-f9d13f779d14-kube-api-access-k2r8n\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961362 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-tuned\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.961437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961401 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:28.962131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-etc-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:28.962131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysctl-d\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:28.962131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961594 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d455697e-d0df-4cb5-b012-f9d13f779d14-serviceca\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:28.962131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961656 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 02:09:28.962131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961845 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 02:09:28.962131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.961850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 02:09:28.962333 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.962291 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vvhbv\"" Jul 21 02:09:28.963172 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.963153 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:28.963273 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:28.963227 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:28.965110 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.965074 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 02:09:28.965200 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.965113 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:09:28.965200 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.965193 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 02:09:28.966071 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.966056 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2m2rw\"" Jul 21 02:09:28.978951 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.978925 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 02:09:28.986582 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.986536 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 02:04:27 +0000 UTC" deadline="2028-04-05 05:19:29.513235656 +0000 UTC" Jul 21 02:09:28.986582 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:28.986581 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14979h10m0.526657709s" Jul 21 02:09:29.054293 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.054271 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 02:09:29.061814 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-hostroot\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.061942 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-kubernetes\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.061942 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061849 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ac91b39-419c-442a-9a35-a5c2bb1b8198-tmp\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.061942 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktb9z\" (UniqueName: \"kubernetes.io/projected/f8069911-9c1d-4284-b705-2a8574c285e6-kube-api-access-ktb9z\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.061942 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovnkube-script-lib\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.061942 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061922 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-cnibin\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-os-release\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061956 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-kubernetes\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.061967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-conf-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062017 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2r8n\" (UniqueName: \"kubernetes.io/projected/d455697e-d0df-4cb5-b012-f9d13f779d14-kube-api-access-k2r8n\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-tuned\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-etc-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.062183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysctl-d\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-multus-certs\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d455697e-d0df-4cb5-b012-f9d13f779d14-serviceca\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-socket-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-systemd\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-etc-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-etc-kubernetes\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062352 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062417 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-systemd\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062467 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysctl-d\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-sys\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-var-lib-kubelet\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.062570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-var-lib-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovnkube-config\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062635 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-socket-dir-parent\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-cni-multus\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062672 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovnkube-script-lib\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062687 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-var-lib-kubelet\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5df84131-c0e2-4311-898d-577cbaa51e3c-konnectivity-ca\") pod \"konnectivity-agent-444p8\" (UID: \"5df84131-c0e2-4311-898d-577cbaa51e3c\") " pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062730 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-sys\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-env-overrides\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-var-lib-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062787 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d455697e-d0df-4cb5-b012-f9d13f779d14-serviceca\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062797 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysconfig\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-node-log\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-k8s-cni-cncf-io\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.063196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062917 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysconfig\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-kubelet\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b15c5c6-0cb8-4289-975e-1bdb353d3354-tmp-dir\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062978 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-modprobe-d\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063088 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-modprobe-d\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063154 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-node-log\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovnkube-config\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.062345 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063307 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5df84131-c0e2-4311-898d-577cbaa51e3c-konnectivity-ca\") pod \"konnectivity-agent-444p8\" (UID: \"5df84131-c0e2-4311-898d-577cbaa51e3c\") " pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063337 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-socket-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063342 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063395 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-dbus\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-openvswitch\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063421 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxgl9\" (UniqueName: \"kubernetes.io/projected/9ac91b39-419c-442a-9a35-a5c2bb1b8198-kube-api-access-qxgl9\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.064051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-cni-bin\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovn-node-metrics-cert\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063518 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-cni-bin\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-registration-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063566 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-sys-fs\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063588 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-registration-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063606 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-lib-modules\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063632 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-systemd\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063661 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-etc-selinux\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063662 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-sys-fs\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063704 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-systemd\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-cni-netd\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063719 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-lib-modules\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.064781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063711 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063742 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-cni-netd\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-netns\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-run\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-kubelet\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063821 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-system-cni-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-cni-binary-copy\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88h7n\" (UniqueName: \"kubernetes.io/projected/0b15c5c6-0cb8-4289-975e-1bdb353d3354-kube-api-access-88h7n\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063888 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063897 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-kubelet\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-system-cni-dir\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063920 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-run\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-cnibin\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-slash\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.063982 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-system-cni-dir\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-cnibin\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2v7s\" (UniqueName: \"kubernetes.io/projected/8cd7a337-6619-44d9-87e9-80231fa4f9ea-kube-api-access-t2v7s\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.065549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064065 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-slash\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-cni-bin\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-os-release\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-run-netns\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-log-socket\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064342 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-cni-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064352 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cd7a337-6619-44d9-87e9-80231fa4f9ea-env-overrides\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-kubelet-config\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064393 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-log-socket\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b15c5c6-0cb8-4289-975e-1bdb353d3354-hosts-file\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064430 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-host-run-netns\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064431 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f8069911-9c1d-4284-b705-2a8574c285e6-os-release\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-device-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfm4\" (UniqueName: \"kubernetes.io/projected/3b13724b-8504-4175-b180-e8ecba075db0-kube-api-access-qmfm4\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064488 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3b13724b-8504-4175-b180-e8ecba075db0-device-dir\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.066222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-ovn\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064652 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/769a71e3-c17f-4a8f-9947-665c9b45508a-iptables-alerter-script\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/769a71e3-c17f-4a8f-9947-665c9b45508a-host-slash\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064734 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysctl-conf\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064740 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-run-ovn\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-systemd-units\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-daemon-config\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064827 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-585px\" (UniqueName: \"kubernetes.io/projected/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-kube-api-access-585px\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064860 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-sysctl-conf\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9pv9\" (UniqueName: \"kubernetes.io/projected/769a71e3-c17f-4a8f-9947-665c9b45508a-kube-api-access-g9pv9\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064894 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fkgg\" (UniqueName: \"kubernetes.io/projected/068fa366-3ec1-4827-8a33-9a020304ed14-kube-api-access-6fkgg\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064897 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cd7a337-6619-44d9-87e9-80231fa4f9ea-systemd-units\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d455697e-d0df-4cb5-b012-f9d13f779d14-host\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.064960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5df84131-c0e2-4311-898d-577cbaa51e3c-agent-certs\") pod \"konnectivity-agent-444p8\" (UID: \"5df84131-c0e2-4311-898d-577cbaa51e3c\") " pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.065044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-host\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.065083 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f8069911-9c1d-4284-b705-2a8574c285e6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.065111 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d455697e-d0df-4cb5-b012-f9d13f779d14-host\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:29.066925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.065148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ac91b39-419c-442a-9a35-a5c2bb1b8198-host\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.067545 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.066286 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ac91b39-419c-442a-9a35-a5c2bb1b8198-etc-tuned\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.067545 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.066730 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ac91b39-419c-442a-9a35-a5c2bb1b8198-tmp\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.067545 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.066957 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cd7a337-6619-44d9-87e9-80231fa4f9ea-ovn-node-metrics-cert\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.067545 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.067543 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5df84131-c0e2-4311-898d-577cbaa51e3c-agent-certs\") pod \"konnectivity-agent-444p8\" (UID: \"5df84131-c0e2-4311-898d-577cbaa51e3c\") " pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:29.075960 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.075936 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gc7r6" Jul 21 02:09:29.079465 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.079440 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 02:09:29.079578 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.079469 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 02:09:29.079578 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.079482 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9txjf for pod openshift-network-diagnostics/network-check-target-lm6kk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:29.079578 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.079573 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf podName:10851644-d2c4-4640-af64-5ea1705e9c20 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:29.579529225 +0000 UTC m=+2.502208310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9txjf" (UniqueName: "kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf") pod "network-check-target-lm6kk" (UID: "10851644-d2c4-4640-af64-5ea1705e9c20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:29.081829 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.081809 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2r8n\" (UniqueName: \"kubernetes.io/projected/d455697e-d0df-4cb5-b012-f9d13f779d14-kube-api-access-k2r8n\") pod \"node-ca-24cm6\" (UID: \"d455697e-d0df-4cb5-b012-f9d13f779d14\") " pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:29.081928 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.081830 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2v7s\" (UniqueName: \"kubernetes.io/projected/8cd7a337-6619-44d9-87e9-80231fa4f9ea-kube-api-access-t2v7s\") pod \"ovnkube-node-ncdpg\" (UID: \"8cd7a337-6619-44d9-87e9-80231fa4f9ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.086035 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.086012 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxgl9\" (UniqueName: \"kubernetes.io/projected/9ac91b39-419c-442a-9a35-a5c2bb1b8198-kube-api-access-qxgl9\") pod \"tuned-l46zf\" (UID: \"9ac91b39-419c-442a-9a35-a5c2bb1b8198\") " pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.086700 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.086680 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktb9z\" (UniqueName: \"kubernetes.io/projected/f8069911-9c1d-4284-b705-2a8574c285e6-kube-api-access-ktb9z\") pod \"multus-additional-cni-plugins-v4wk6\" (UID: \"f8069911-9c1d-4284-b705-2a8574c285e6\") " pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.086808 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.086736 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmfm4\" (UniqueName: \"kubernetes.io/projected/3b13724b-8504-4175-b180-e8ecba075db0-kube-api-access-qmfm4\") pod \"aws-ebs-csi-driver-node-9rxf4\" (UID: \"3b13724b-8504-4175-b180-e8ecba075db0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.088522 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.088501 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gc7r6" Jul 21 02:09:29.158634 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.158599 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97019cada6ca6a03a3f478301c10efa.slice/crio-ca59daa3275adb6b5338089411e6c755f135f82521df496d8dfa363bb368b060 WatchSource:0}: Error finding container ca59daa3275adb6b5338089411e6c755f135f82521df496d8dfa363bb368b060: Status 404 returned error can't find the container with id ca59daa3275adb6b5338089411e6c755f135f82521df496d8dfa363bb368b060 Jul 21 02:09:29.159016 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.158992 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76dd8f90c35661213ff157ece2ab0348.slice/crio-d4817619bcd2a9f078c7ea947e8cf6976400176b280ca739c1a51fe5a68fb4ec WatchSource:0}: Error finding container d4817619bcd2a9f078c7ea947e8cf6976400176b280ca739c1a51fe5a68fb4ec: Status 404 returned error can't find the container with id d4817619bcd2a9f078c7ea947e8cf6976400176b280ca739c1a51fe5a68fb4ec Jul 21 02:09:29.164354 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.164338 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 02:09:29.165701 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/769a71e3-c17f-4a8f-9947-665c9b45508a-iptables-alerter-script\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.165782 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/769a71e3-c17f-4a8f-9947-665c9b45508a-host-slash\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.165782 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165749 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/769a71e3-c17f-4a8f-9947-665c9b45508a-host-slash\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.165782 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-daemon-config\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-585px\" (UniqueName: \"kubernetes.io/projected/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-kube-api-access-585px\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9pv9\" (UniqueName: \"kubernetes.io/projected/769a71e3-c17f-4a8f-9947-665c9b45508a-kube-api-access-g9pv9\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165822 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fkgg\" (UniqueName: \"kubernetes.io/projected/068fa366-3ec1-4827-8a33-9a020304ed14-kube-api-access-6fkgg\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-hostroot\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-cnibin\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-os-release\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-conf-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-hostroot\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.165971 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-cnibin\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166026 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-os-release\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-multus-certs\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166056 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-conf-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166065 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-multus-certs\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-etc-kubernetes\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166100 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-etc-kubernetes\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-socket-dir-parent\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-cni-multus\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.166187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166176 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-socket-dir-parent\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-k8s-cni-cncf-io\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-k8s-cni-cncf-io\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166217 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-cni-multus\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166249 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-kubelet\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b15c5c6-0cb8-4289-975e-1bdb353d3354-tmp-dir\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166310 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-daemon-config\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-dbus\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166352 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-kubelet\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-netns\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-system-cni-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166408 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-cni-binary-copy\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88h7n\" (UniqueName: \"kubernetes.io/projected/0b15c5c6-0cb8-4289-975e-1bdb353d3354-kube-api-access-88h7n\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166459 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-system-cni-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166459 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-dbus\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166461 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-run-netns\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-cni-bin\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166528 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-cni-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.166550 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166553 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-kubelet-config\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b15c5c6-0cb8-4289-975e-1bdb353d3354-hosts-file\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.166648 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs podName:068fa366-3ec1-4827-8a33-9a020304ed14 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:29.666627948 +0000 UTC m=+2.589307058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs") pod "network-metrics-daemon-b94xm" (UID: "068fa366-3ec1-4827-8a33-9a020304ed14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166630 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b15c5c6-0cb8-4289-975e-1bdb353d3354-tmp-dir\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166710 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-kubelet-config\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.166749 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166791 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-multus-cni-dir\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.166800 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret podName:6506f074-f794-43ca-9b7f-59c5ad3ef8b9 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:29.6667841 +0000 UTC m=+2.589463199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret") pod "global-pull-secret-syncer-dlvc8" (UID: "6506f074-f794-43ca-9b7f-59c5ad3ef8b9") : object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166749 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-host-var-lib-cni-bin\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166806 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/769a71e3-c17f-4a8f-9947-665c9b45508a-iptables-alerter-script\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166842 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b15c5c6-0cb8-4289-975e-1bdb353d3354-hosts-file\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.167695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.166897 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-cni-binary-copy\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.175286 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.175267 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 02:09:29.177464 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.177445 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88h7n\" (UniqueName: \"kubernetes.io/projected/0b15c5c6-0cb8-4289-975e-1bdb353d3354-kube-api-access-88h7n\") pod \"node-resolver-zsfmr\" (UID: \"0b15c5c6-0cb8-4289-975e-1bdb353d3354\") " pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.177464 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.177449 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9pv9\" (UniqueName: \"kubernetes.io/projected/769a71e3-c17f-4a8f-9947-665c9b45508a-kube-api-access-g9pv9\") pod \"iptables-alerter-pg2b2\" (UID: \"769a71e3-c17f-4a8f-9947-665c9b45508a\") " pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.177627 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.177607 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-585px\" (UniqueName: \"kubernetes.io/projected/0736c8d1-e8cf-4718-ac63-54c3d1adc4af-kube-api-access-585px\") pod \"multus-wl8hl\" (UID: \"0736c8d1-e8cf-4718-ac63-54c3d1adc4af\") " pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.177774 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.177760 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fkgg\" (UniqueName: \"kubernetes.io/projected/068fa366-3ec1-4827-8a33-9a020304ed14-kube-api-access-6fkgg\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:29.230483 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.230394 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 02:09:29.286726 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.286696 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l46zf" Jul 21 02:09:29.296251 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.296220 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac91b39_419c_442a_9a35_a5c2bb1b8198.slice/crio-061d3620c61ac0415ec309fb3a7db6f4315bad9b21a2f69225b0163335413812 WatchSource:0}: Error finding container 061d3620c61ac0415ec309fb3a7db6f4315bad9b21a2f69225b0163335413812: Status 404 returned error can't find the container with id 061d3620c61ac0415ec309fb3a7db6f4315bad9b21a2f69225b0163335413812 Jul 21 02:09:29.301332 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.301315 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-24cm6" Jul 21 02:09:29.310002 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.309941 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd455697e_d0df_4cb5_b012_f9d13f779d14.slice/crio-0dd0d30ee6c650feb7ad20b075be3a93d1559316fe6ff116fb2f6e3e98fa3632 WatchSource:0}: Error finding container 0dd0d30ee6c650feb7ad20b075be3a93d1559316fe6ff116fb2f6e3e98fa3632: Status 404 returned error can't find the container with id 0dd0d30ee6c650feb7ad20b075be3a93d1559316fe6ff116fb2f6e3e98fa3632 Jul 21 02:09:29.320855 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.320831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" Jul 21 02:09:29.329110 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.329080 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8069911_9c1d_4284_b705_2a8574c285e6.slice/crio-67f36fbdfdd18d0b175ac11f0bb78dfd9bbbd4aa8c5d9cab8935574453b279a7 WatchSource:0}: Error finding container 67f36fbdfdd18d0b175ac11f0bb78dfd9bbbd4aa8c5d9cab8935574453b279a7: Status 404 returned error can't find the container with id 67f36fbdfdd18d0b175ac11f0bb78dfd9bbbd4aa8c5d9cab8935574453b279a7 Jul 21 02:09:29.337270 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.337240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:29.347084 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.347059 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd7a337_6619_44d9_87e9_80231fa4f9ea.slice/crio-7e454463e804dab56ee86d77dd898a9b769ede6da5c9c39f808b90518ef9d124 WatchSource:0}: Error finding container 7e454463e804dab56ee86d77dd898a9b769ede6da5c9c39f808b90518ef9d124: Status 404 returned error can't find the container with id 7e454463e804dab56ee86d77dd898a9b769ede6da5c9c39f808b90518ef9d124 Jul 21 02:09:29.347185 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.347142 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:29.355777 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.355755 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df84131_c0e2_4311_898d_577cbaa51e3c.slice/crio-42994db02e36308069a7616a3505234f18ef3762f65eb4da6ddc40272654df5b WatchSource:0}: Error finding container 42994db02e36308069a7616a3505234f18ef3762f65eb4da6ddc40272654df5b: Status 404 returned error can't find the container with id 42994db02e36308069a7616a3505234f18ef3762f65eb4da6ddc40272654df5b Jul 21 02:09:29.366298 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.366280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" Jul 21 02:09:29.374236 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.374211 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b13724b_8504_4175_b180_e8ecba075db0.slice/crio-6c443917c85fcc1c948ad5ade629e66d43701cd32f8b4db6fb05c7f7ab2700a9 WatchSource:0}: Error finding container 6c443917c85fcc1c948ad5ade629e66d43701cd32f8b4db6fb05c7f7ab2700a9: Status 404 returned error can't find the container with id 6c443917c85fcc1c948ad5ade629e66d43701cd32f8b4db6fb05c7f7ab2700a9 Jul 21 02:09:29.381609 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.381588 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zsfmr" Jul 21 02:09:29.389863 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.389837 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b15c5c6_0cb8_4289_975e_1bdb353d3354.slice/crio-a57f98ccafe408926dd1eccb8cbee099668db44f639f8c211b6bf914ed5d69cb WatchSource:0}: Error finding container a57f98ccafe408926dd1eccb8cbee099668db44f639f8c211b6bf914ed5d69cb: Status 404 returned error can't find the container with id a57f98ccafe408926dd1eccb8cbee099668db44f639f8c211b6bf914ed5d69cb Jul 21 02:09:29.401114 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.401095 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wl8hl" Jul 21 02:09:29.406465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.406445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pg2b2" Jul 21 02:09:29.409949 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.409924 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0736c8d1_e8cf_4718_ac63_54c3d1adc4af.slice/crio-6d4e2d4d99404dcf85b46c4c6674b84adafe92286e6ec670a9f20a9263fe35c6 WatchSource:0}: Error finding container 6d4e2d4d99404dcf85b46c4c6674b84adafe92286e6ec670a9f20a9263fe35c6: Status 404 returned error can't find the container with id 6d4e2d4d99404dcf85b46c4c6674b84adafe92286e6ec670a9f20a9263fe35c6 Jul 21 02:09:29.414978 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:09:29.414952 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769a71e3_c17f_4a8f_9947_665c9b45508a.slice/crio-1edefd7ac299f461ab5638fbab294700cb05d3e46fea2309d3e45f9cd3c37458 WatchSource:0}: Error finding container 1edefd7ac299f461ab5638fbab294700cb05d3e46fea2309d3e45f9cd3c37458: Status 404 returned error can't find the container with id 1edefd7ac299f461ab5638fbab294700cb05d3e46fea2309d3e45f9cd3c37458 Jul 21 02:09:29.668961 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.668925 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:29.669126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.668977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:29.669126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:29.669026 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:29.669126 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669110 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:29.669126 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669116 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 02:09:29.669294 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669140 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 02:09:29.669294 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669153 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9txjf for pod openshift-network-diagnostics/network-check-target-lm6kk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:29.669294 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669165 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret podName:6506f074-f794-43ca-9b7f-59c5ad3ef8b9 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:30.669147681 +0000 UTC m=+3.591826767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret") pod "global-pull-secret-syncer-dlvc8" (UID: "6506f074-f794-43ca-9b7f-59c5ad3ef8b9") : object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:29.669294 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669192 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:29.669294 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669206 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf podName:10851644-d2c4-4640-af64-5ea1705e9c20 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:30.669188171 +0000 UTC m=+3.591867279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9txjf" (UniqueName: "kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf") pod "network-check-target-lm6kk" (UID: "10851644-d2c4-4640-af64-5ea1705e9c20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:29.669294 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:29.669232 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs podName:068fa366-3ec1-4827-8a33-9a020304ed14 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:30.669220995 +0000 UTC m=+3.591900093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs") pod "network-metrics-daemon-b94xm" (UID: "068fa366-3ec1-4827-8a33-9a020304ed14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:30.092043 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.091922 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 02:04:29 +0000 UTC" deadline="2028-04-10 04:38:21.59010353 +0000 UTC" Jul 21 02:09:30.092043 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.091985 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15098h28m51.49812181s" Jul 21 02:09:30.123990 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.123192 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:30.123990 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.123345 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:30.157565 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.157467 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zsfmr" event={"ID":"0b15c5c6-0cb8-4289-975e-1bdb353d3354","Type":"ContainerStarted","Data":"a57f98ccafe408926dd1eccb8cbee099668db44f639f8c211b6bf914ed5d69cb"} Jul 21 02:09:30.160182 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.160141 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerStarted","Data":"67f36fbdfdd18d0b175ac11f0bb78dfd9bbbd4aa8c5d9cab8935574453b279a7"} Jul 21 02:09:30.179935 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.179780 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-24cm6" event={"ID":"d455697e-d0df-4cb5-b012-f9d13f779d14","Type":"ContainerStarted","Data":"0dd0d30ee6c650feb7ad20b075be3a93d1559316fe6ff116fb2f6e3e98fa3632"} Jul 21 02:09:30.185992 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.185944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l46zf" event={"ID":"9ac91b39-419c-442a-9a35-a5c2bb1b8198","Type":"ContainerStarted","Data":"061d3620c61ac0415ec309fb3a7db6f4315bad9b21a2f69225b0163335413812"} Jul 21 02:09:30.202204 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.202167 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" event={"ID":"76dd8f90c35661213ff157ece2ab0348","Type":"ContainerStarted","Data":"d4817619bcd2a9f078c7ea947e8cf6976400176b280ca739c1a51fe5a68fb4ec"} Jul 21 02:09:30.223519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.223480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pg2b2" event={"ID":"769a71e3-c17f-4a8f-9947-665c9b45508a","Type":"ContainerStarted","Data":"1edefd7ac299f461ab5638fbab294700cb05d3e46fea2309d3e45f9cd3c37458"} Jul 21 02:09:30.238175 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.238143 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 02:09:30.258340 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.258267 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wl8hl" event={"ID":"0736c8d1-e8cf-4718-ac63-54c3d1adc4af","Type":"ContainerStarted","Data":"6d4e2d4d99404dcf85b46c4c6674b84adafe92286e6ec670a9f20a9263fe35c6"} Jul 21 02:09:30.287449 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.287408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" event={"ID":"3b13724b-8504-4175-b180-e8ecba075db0","Type":"ContainerStarted","Data":"6c443917c85fcc1c948ad5ade629e66d43701cd32f8b4db6fb05c7f7ab2700a9"} Jul 21 02:09:30.294342 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.294298 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-444p8" event={"ID":"5df84131-c0e2-4311-898d-577cbaa51e3c","Type":"ContainerStarted","Data":"42994db02e36308069a7616a3505234f18ef3762f65eb4da6ddc40272654df5b"} Jul 21 02:09:30.343366 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.343197 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"7e454463e804dab56ee86d77dd898a9b769ede6da5c9c39f808b90518ef9d124"} Jul 21 02:09:30.369099 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.369046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" event={"ID":"b97019cada6ca6a03a3f478301c10efa","Type":"ContainerStarted","Data":"ca59daa3275adb6b5338089411e6c755f135f82521df496d8dfa363bb368b060"} Jul 21 02:09:30.677460 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.677379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:30.677460 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.677429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:30.677690 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:30.677478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:30.677690 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677559 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:30.677690 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677632 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs podName:068fa366-3ec1-4827-8a33-9a020304ed14 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:32.677612124 +0000 UTC m=+5.600291220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs") pod "network-metrics-daemon-b94xm" (UID: "068fa366-3ec1-4827-8a33-9a020304ed14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:30.677690 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677641 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 02:09:30.677690 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677662 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 02:09:30.677690 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677674 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9txjf for pod openshift-network-diagnostics/network-check-target-lm6kk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:30.677994 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677719 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf podName:10851644-d2c4-4640-af64-5ea1705e9c20 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:32.677704784 +0000 UTC m=+5.600383886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9txjf" (UniqueName: "kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf") pod "network-check-target-lm6kk" (UID: "10851644-d2c4-4640-af64-5ea1705e9c20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:30.677994 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677785 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:30.677994 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:30.677816 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret podName:6506f074-f794-43ca-9b7f-59c5ad3ef8b9 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:32.677805904 +0000 UTC m=+5.600485005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret") pod "global-pull-secret-syncer-dlvc8" (UID: "6506f074-f794-43ca-9b7f-59c5ad3ef8b9") : object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:31.092177 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:31.092133 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 02:04:29 +0000 UTC" deadline="2028-03-08 03:29:23.417949975 +0000 UTC" Jul 21 02:09:31.092177 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:31.092176 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14305h19m52.325778973s" Jul 21 02:09:31.120466 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:31.120436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:31.120639 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:31.120562 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:31.120639 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:31.120576 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:31.120750 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:31.120720 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:32.127089 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:32.124691 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:32.127089 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.124889 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:32.696771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:32.696842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:32.696871 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697001 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697064 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret podName:6506f074-f794-43ca-9b7f-59c5ad3ef8b9 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:36.697045404 +0000 UTC m=+9.619724496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret") pod "global-pull-secret-syncer-dlvc8" (UID: "6506f074-f794-43ca-9b7f-59c5ad3ef8b9") : object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697486 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697507 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697519 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9txjf for pod openshift-network-diagnostics/network-check-target-lm6kk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697564 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf podName:10851644-d2c4-4640-af64-5ea1705e9c20 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:36.697549406 +0000 UTC m=+9.620228496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9txjf" (UniqueName: "kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf") pod "network-check-target-lm6kk" (UID: "10851644-d2c4-4640-af64-5ea1705e9c20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697624 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:32.697688 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:32.697654 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs podName:068fa366-3ec1-4827-8a33-9a020304ed14 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:36.697643986 +0000 UTC m=+9.620323076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs") pod "network-metrics-daemon-b94xm" (UID: "068fa366-3ec1-4827-8a33-9a020304ed14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:33.121920 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:33.121316 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:33.121920 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:33.121441 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:33.121920 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:33.121517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:33.121920 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:33.121589 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:34.120898 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:34.120863 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:34.121344 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:34.121012 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:35.121110 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:35.121079 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:35.121558 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:35.121080 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:35.121558 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:35.121234 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:35.121558 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:35.121328 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:36.120442 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:36.120407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:36.120631 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.120554 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:36.731305 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:36.731244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:36.731321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:36.731376 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731446 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731514 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731523 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731525 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs podName:068fa366-3ec1-4827-8a33-9a020304ed14 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:44.731504483 +0000 UTC m=+17.654183590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs") pod "network-metrics-daemon-b94xm" (UID: "068fa366-3ec1-4827-8a33-9a020304ed14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731592 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret podName:6506f074-f794-43ca-9b7f-59c5ad3ef8b9 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:44.731574373 +0000 UTC m=+17.654253458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret") pod "global-pull-secret-syncer-dlvc8" (UID: "6506f074-f794-43ca-9b7f-59c5ad3ef8b9") : object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731533 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731623 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9txjf for pod openshift-network-diagnostics/network-check-target-lm6kk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:36.731762 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:36.731656 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf podName:10851644-d2c4-4640-af64-5ea1705e9c20 nodeName:}" failed. No retries permitted until 2026-07-21 02:09:44.731647064 +0000 UTC m=+17.654326150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9txjf" (UniqueName: "kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf") pod "network-check-target-lm6kk" (UID: "10851644-d2c4-4640-af64-5ea1705e9c20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:37.120800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:37.120767 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:37.120800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:37.120798 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:37.121034 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:37.120905 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:37.121092 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:37.121028 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:38.122477 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:38.121954 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:38.122477 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:38.122082 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:39.120759 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:39.120701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:39.120963 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:39.120846 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:39.120963 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:39.120908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:39.121070 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:39.121028 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:40.120665 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:40.120624 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:40.121158 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:40.120778 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:41.121055 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:41.121020 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:41.121531 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:41.121018 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:41.121531 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:41.121148 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:41.121531 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:41.121228 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:42.120726 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:42.120692 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:42.120906 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:42.120830 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:43.120555 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:43.120521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:43.120951 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:43.120521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:43.120951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:43.120671 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:43.120951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:43.120719 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:44.120607 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:44.120572 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:44.121021 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.120737 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:44.790688 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:44.790651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:44.790688 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:44.790693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:44.790951 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:44.790733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:44.790951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.790812 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:44.790951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.790865 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 02:09:44.790951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.790886 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 02:09:44.790951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.790902 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9txjf for pod openshift-network-diagnostics/network-check-target-lm6kk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:44.790951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.790885 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs podName:068fa366-3ec1-4827-8a33-9a020304ed14 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:00.790861913 +0000 UTC m=+33.713541003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs") pod "network-metrics-daemon-b94xm" (UID: "068fa366-3ec1-4827-8a33-9a020304ed14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:09:44.790951 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.790947 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf podName:10851644-d2c4-4640-af64-5ea1705e9c20 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:00.790937707 +0000 UTC m=+33.713616797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9txjf" (UniqueName: "kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf") pod "network-check-target-lm6kk" (UID: "10851644-d2c4-4640-af64-5ea1705e9c20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:09:44.791247 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.790950 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:44.791247 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:44.791023 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret podName:6506f074-f794-43ca-9b7f-59c5ad3ef8b9 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:00.791003869 +0000 UTC m=+33.713682972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret") pod "global-pull-secret-syncer-dlvc8" (UID: "6506f074-f794-43ca-9b7f-59c5ad3ef8b9") : object "kube-system"/"original-pull-secret" not registered Jul 21 02:09:45.121050 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:45.120960 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:45.121575 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:45.120960 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:45.121575 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:45.121093 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:45.121575 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:45.121142 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:46.120346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:46.120308 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:46.120506 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:46.120461 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:47.120155 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:47.120120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:47.120623 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:47.120120 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:47.120623 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:47.120280 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:47.120623 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:47.120351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:48.121652 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:48.121609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:48.122123 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:48.121735 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:49.120394 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.120106 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:49.120831 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:49.120519 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:49.120831 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.120562 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:49.120831 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:49.120640 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:49.408753 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.408723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wl8hl" event={"ID":"0736c8d1-e8cf-4718-ac63-54c3d1adc4af","Type":"ContainerStarted","Data":"af058e7ed522c99add0e05e18a49da5fee5d9776f973d9b0c24e3a0cdf37949b"} Jul 21 02:09:49.410180 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.410158 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" event={"ID":"3b13724b-8504-4175-b180-e8ecba075db0","Type":"ContainerStarted","Data":"449078ac50dea474b62939500f7bd59bf9aa57854e6785ddebc39e2892cf13a7"} Jul 21 02:09:49.411399 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.411375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-444p8" event={"ID":"5df84131-c0e2-4311-898d-577cbaa51e3c","Type":"ContainerStarted","Data":"548a1909244bf1bc8c66f2726ea4dac2bf5ecb1f80532fd3111e79323dadcb51"} Jul 21 02:09:49.416504 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.416476 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"e8f53234b9534799dfe0b19cc7a5dcc0b7aef777b3cd2e0475939556a0dd976c"} Jul 21 02:09:49.416603 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.416582 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"020b3c56973ea8157142effae6d2fbf239141d8a25d790f169e99c9f48db54e9"} Jul 21 02:09:49.416652 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.416621 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"2b9026575efffe04d00e0e429ec668693d65633689ee392e7f930e0195466add"} Jul 21 02:09:49.416705 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.416666 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"f2ebc01fa1243a7ad09362e26f9f809ceb4c053dac7be3f351254ffb00cdfada"} Jul 21 02:09:49.419738 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.419708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" event={"ID":"b97019cada6ca6a03a3f478301c10efa","Type":"ContainerStarted","Data":"5c22574dd119175ad11ef4a20bf309e2539da1f0ef238dcd6a0a683e6dd633eb"} Jul 21 02:09:49.421506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.421485 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zsfmr" event={"ID":"0b15c5c6-0cb8-4289-975e-1bdb353d3354","Type":"ContainerStarted","Data":"36cdb2fe089bfaa600f2eaab6b6611de79ab7bfa8b74358d7e71bbf90937a380"} Jul 21 02:09:49.423143 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.423116 2565 generic.go:356] "Generic (PLEG): container finished" podID="f8069911-9c1d-4284-b705-2a8574c285e6" containerID="531f43864ca05164156228fa1bb779951ccef4f99ff9b3d0731cc28d188db471" exitCode=0 Jul 21 02:09:49.423212 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.423144 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerDied","Data":"531f43864ca05164156228fa1bb779951ccef4f99ff9b3d0731cc28d188db471"} Jul 21 02:09:49.424840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.424816 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-24cm6" event={"ID":"d455697e-d0df-4cb5-b012-f9d13f779d14","Type":"ContainerStarted","Data":"542294a64a66f51f6386e53469631e834d388f43e6e097ce5e36d74028798db7"} Jul 21 02:09:49.426276 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.426236 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l46zf" event={"ID":"9ac91b39-419c-442a-9a35-a5c2bb1b8198","Type":"ContainerStarted","Data":"2e7a788962f64aedbff491f13fb38b045923713f5a0fc8ddb2df8b0c68e93a68"} Jul 21 02:09:49.427857 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.427835 2565 generic.go:356] "Generic (PLEG): container finished" podID="76dd8f90c35661213ff157ece2ab0348" containerID="e299c1297aa9c89c1107f0f8f2505cbe384f554e05c9f71d1311393625cc65b5" exitCode=0 Jul 21 02:09:49.427921 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.427868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" event={"ID":"76dd8f90c35661213ff157ece2ab0348","Type":"ContainerDied","Data":"e299c1297aa9c89c1107f0f8f2505cbe384f554e05c9f71d1311393625cc65b5"} Jul 21 02:09:49.431140 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.431098 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wl8hl" podStartSLOduration=2.063681189 podStartE2EDuration="21.431087177s" totalImagesPullingTime="19.367405988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:49.430601859 +0000 UTC m=+22.353280993" watchObservedRunningTime="2026-07-21 02:09:49.431087177 +0000 UTC m=+22.353766284" Jul 21 02:09:49.447508 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.447462 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-444p8" podStartSLOduration=2.026083968 podStartE2EDuration="21.447446263s" totalImagesPullingTime="19.421362295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:49.446805668 +0000 UTC m=+22.369484788" watchObservedRunningTime="2026-07-21 02:09:49.447446263 +0000 UTC m=+22.370125369" Jul 21 02:09:49.461739 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.461695 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zsfmr" podStartSLOduration=2.070138334 podStartE2EDuration="21.461679325s" totalImagesPullingTime="19.391540991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:49.461383088 +0000 UTC m=+22.384062213" watchObservedRunningTime="2026-07-21 02:09:49.461679325 +0000 UTC m=+22.384358431" Jul 21 02:09:49.476681 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.476635 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-128.ec2.internal" podStartSLOduration=21.476617188 podStartE2EDuration="21.476617188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:49.476190795 +0000 UTC m=+22.398869901" watchObservedRunningTime="2026-07-21 02:09:49.476617188 +0000 UTC m=+22.399296294" Jul 21 02:09:49.498038 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:49.497992 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l46zf" podStartSLOduration=2.08306973 podStartE2EDuration="21.497977594s" totalImagesPullingTime="19.414907864s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:49.49769923 +0000 UTC m=+22.420378363" watchObservedRunningTime="2026-07-21 02:09:49.497977594 +0000 UTC m=+22.420656700" Jul 21 02:09:50.121027 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.120913 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:50.121198 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:50.121068 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:50.413324 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.413236 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:50.414336 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.414138 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:50.431533 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.431500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pg2b2" event={"ID":"769a71e3-c17f-4a8f-9947-665c9b45508a","Type":"ContainerStarted","Data":"3fa9e6e99ffae63e2c8baa2485ac102ca64f8cf4d2705a63c417508c535efb59"} Jul 21 02:09:50.435316 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.435288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"67ddcc6509df3f259882366ac4574e81532532b30662e1d643cca6c54e4cef65"} Jul 21 02:09:50.435457 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.435365 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"dc0df10525fb6eaf6af3f721423608508a56d7c85d4bf2adc3f73becbdc5bce0"} Jul 21 02:09:50.435799 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.435775 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:50.446033 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.443666 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-444p8" Jul 21 02:09:50.446033 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.445786 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-24cm6" podStartSLOduration=3.000754774 podStartE2EDuration="22.445767152s" totalImagesPullingTime="19.445012378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:49.565897319 +0000 UTC m=+22.488576445" watchObservedRunningTime="2026-07-21 02:09:50.445767152 +0000 UTC m=+23.368446260" Jul 21 02:09:50.462998 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.462947 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pg2b2" podStartSLOduration=3.166849165 podStartE2EDuration="22.462932484s" totalImagesPullingTime="19.296083319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:50.462165465 +0000 UTC m=+23.384844590" watchObservedRunningTime="2026-07-21 02:09:50.462932484 +0000 UTC m=+23.385611590" Jul 21 02:09:50.686060 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:50.686021 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 02:09:51.023096 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:51.022908 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T02:09:50.68604531Z","UUID":"021d50da-3708-4bbb-bbe0-22260f1a75c5","Handler":null,"Name":"","Endpoint":""} Jul 21 02:09:51.024690 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:51.024666 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 02:09:51.024824 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:51.024709 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 02:09:51.120558 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:51.120512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:51.120743 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:51.120695 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:51.120743 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:51.120729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:51.120879 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:51.120844 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:51.439762 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:51.439670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" event={"ID":"76dd8f90c35661213ff157ece2ab0348","Type":"ContainerStarted","Data":"3cf258d0f4006d9567da5baa6edf3bf336dfa068363c3bd563a105c15829901f"} Jul 21 02:09:51.442001 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:51.441909 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" event={"ID":"3b13724b-8504-4175-b180-e8ecba075db0","Type":"ContainerStarted","Data":"db877248b1b0e26f6531bbd7a8fb6c799b723749ec26dd04883d84ada053fcad"} Jul 21 02:09:52.120943 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:52.120907 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:52.121188 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:52.121020 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:52.449953 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:52.449833 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"4f264555229fe4bde39c9d805d2a4d59bbd01ac842b99ac9dcedc0d89bd7a03d"} Jul 21 02:09:53.120970 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:53.120936 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:53.120970 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:53.120977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:53.121240 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:53.121064 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:53.121316 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:53.121221 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:54.120597 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.120425 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:54.121168 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:54.120689 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:54.457384 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.457289 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" event={"ID":"3b13724b-8504-4175-b180-e8ecba075db0","Type":"ContainerStarted","Data":"c36a021152faa7c7985df59d0400f54dfe3a91d9b7b47b953816a7f480f672bd"} Jul 21 02:09:54.460432 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.460397 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" event={"ID":"8cd7a337-6619-44d9-87e9-80231fa4f9ea","Type":"ContainerStarted","Data":"e4b1f905be0c1bc4bdae20b898d95661624d61fca64a5e95b05701e097170b2e"} Jul 21 02:09:54.460633 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.460617 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:54.460717 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.460690 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:54.460770 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.460740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:54.462377 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.462353 2565 generic.go:356] "Generic (PLEG): container finished" podID="f8069911-9c1d-4284-b705-2a8574c285e6" containerID="ef01ab14e58987117a5e48e4049ed18780731acb5b0e5a6f71a83002833d2270" exitCode=0 Jul 21 02:09:54.462490 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.462403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerDied","Data":"ef01ab14e58987117a5e48e4049ed18780731acb5b0e5a6f71a83002833d2270"} Jul 21 02:09:54.476570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.476540 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:54.476717 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.476655 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:09:54.489754 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.489700 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9rxf4" podStartSLOduration=2.619506341 podStartE2EDuration="26.489676918s" totalImagesPullingTime="23.870170577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:54.483148673 +0000 UTC m=+27.405827779" watchObservedRunningTime="2026-07-21 02:09:54.489676918 +0000 UTC m=+27.412356024" Jul 21 02:09:54.490359 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.490327 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-128.ec2.internal" podStartSLOduration=26.490315069 podStartE2EDuration="26.490315069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:51.45933798 +0000 UTC m=+24.382017086" watchObservedRunningTime="2026-07-21 02:09:54.490315069 +0000 UTC m=+27.412994176" Jul 21 02:09:54.541056 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:54.541004 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" podStartSLOduration=7.004169764 podStartE2EDuration="26.540986924s" totalImagesPullingTime="19.53681716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:09:54.539277814 +0000 UTC m=+27.461956920" watchObservedRunningTime="2026-07-21 02:09:54.540986924 +0000 UTC m=+27.463666030" Jul 21 02:09:55.121404 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.121315 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:55.122066 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:55.121463 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:55.122066 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.121488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:55.122066 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:55.121595 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:55.910562 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.910526 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlvc8"] Jul 21 02:09:55.910742 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.910629 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:55.910742 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:55.910721 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:55.913189 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.913158 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lm6kk"] Jul 21 02:09:55.913338 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.913248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:55.913381 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:55.913352 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:55.916112 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.916084 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b94xm"] Jul 21 02:09:55.916311 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:55.916199 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:55.916377 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:55.916329 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:56.468997 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:56.468952 2565 generic.go:356] "Generic (PLEG): container finished" podID="f8069911-9c1d-4284-b705-2a8574c285e6" containerID="8ad00949301abfe3b39e4e15d5779ed0f5a0ac1f947deed841981583bfb994c1" exitCode=0 Jul 21 02:09:56.469663 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:56.469019 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerDied","Data":"8ad00949301abfe3b39e4e15d5779ed0f5a0ac1f947deed841981583bfb994c1"} Jul 21 02:09:58.121765 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:58.121528 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:09:58.122178 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:58.121606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:09:58.122178 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:58.121634 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:09:58.122178 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:58.121767 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:09:58.122178 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:58.121852 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:09:58.122178 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:09:58.121965 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:09:58.476511 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:58.476421 2565 generic.go:356] "Generic (PLEG): container finished" podID="f8069911-9c1d-4284-b705-2a8574c285e6" containerID="080d56c97747fe3261a9a9aad706f33f2abf36a77e052231379a0591ee7ff3e9" exitCode=0 Jul 21 02:09:58.476511 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:09:58.476479 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerDied","Data":"080d56c97747fe3261a9a9aad706f33f2abf36a77e052231379a0591ee7ff3e9"} Jul 21 02:10:00.120208 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:00.120173 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:10:00.120642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:00.120173 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:10:00.120642 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.120319 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lm6kk" podUID="10851644-d2c4-4640-af64-5ea1705e9c20" Jul 21 02:10:00.120642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:00.120178 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:10:00.120642 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.120386 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dlvc8" podUID="6506f074-f794-43ca-9b7f-59c5ad3ef8b9" Jul 21 02:10:00.120642 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.120485 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b94xm" podUID="068fa366-3ec1-4827-8a33-9a020304ed14" Jul 21 02:10:00.804769 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:00.804694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:10:00.804954 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:00.804800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:10:00.804954 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:00.804835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:10:00.804954 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.804882 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:10:00.804954 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.804934 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 02:10:00.804954 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.804953 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs podName:068fa366-3ec1-4827-8a33-9a020304ed14 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:32.804934336 +0000 UTC m=+65.727613429 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs") pod "network-metrics-daemon-b94xm" (UID: "068fa366-3ec1-4827-8a33-9a020304ed14") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 02:10:00.805163 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.804980 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret podName:6506f074-f794-43ca-9b7f-59c5ad3ef8b9 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:32.804964842 +0000 UTC m=+65.727643931 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret") pod "global-pull-secret-syncer-dlvc8" (UID: "6506f074-f794-43ca-9b7f-59c5ad3ef8b9") : object "kube-system"/"original-pull-secret" not registered Jul 21 02:10:00.805163 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.804884 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 02:10:00.805163 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.805005 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 02:10:00.805163 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.805039 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9txjf for pod openshift-network-diagnostics/network-check-target-lm6kk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:10:00.805163 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:00.805076 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf podName:10851644-d2c4-4640-af64-5ea1705e9c20 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:32.805066997 +0000 UTC m=+65.727746083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9txjf" (UniqueName: "kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf") pod "network-check-target-lm6kk" (UID: "10851644-d2c4-4640-af64-5ea1705e9c20") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 02:10:01.843449 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.843425 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-128.ec2.internal" event="NodeReady" Jul 21 02:10:01.843868 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.843572 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 02:10:01.883113 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.883083 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fb4748b6c-nrr7x"] Jul 21 02:10:01.885722 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.885697 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:01.888608 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.888022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f"] Jul 21 02:10:01.888959 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.888934 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 02:10:01.889389 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.889195 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 02:10:01.889492 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.889425 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 02:10:01.889555 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.889485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qdf5\"" Jul 21 02:10:01.889815 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.889762 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xpmg4"] Jul 21 02:10:01.889923 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.889896 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" Jul 21 02:10:01.891515 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.891496 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz"] Jul 21 02:10:01.891658 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.891636 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:01.893267 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.893236 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw"] Jul 21 02:10:01.893377 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.893354 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:01.893958 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.893938 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.894183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.894163 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-t47q9\"" Jul 21 02:10:01.894517 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.894437 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.895245 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.895228 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:01.896737 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.896721 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx"] Jul 21 02:10:01.897702 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.897680 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.897702 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.897694 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 21 02:10:01.898554 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.898538 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85d48988cd-47vhx"] Jul 21 02:10:01.898678 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.898661 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:01.899166 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.899146 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.900161 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.900144 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 02:10:01.900236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.900163 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.900334 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.900318 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 21 02:10:01.900800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.900417 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.900800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.900684 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.900800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.900687 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-l8qbl\"" Jul 21 02:10:01.900949 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.900821 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wjbzt\"" Jul 21 02:10:01.901191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.901078 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rc8hc"] Jul 21 02:10:01.901191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.901102 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.901191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.901118 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 21 02:10:01.902319 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.901843 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vn7mr\"" Jul 21 02:10:01.905870 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.905849 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 21 02:10:01.906640 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.906621 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 02:10:01.907046 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.907026 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:01.907698 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.907681 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9"] Jul 21 02:10:01.908137 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.908103 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.908217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.908137 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:01.908217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.908178 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 02:10:01.908671 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.908506 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 02:10:01.908671 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.908663 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.908816 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.908686 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6s787\"" Jul 21 02:10:01.909784 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.909768 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:01.911634 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.911616 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.911815 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.911788 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 21 02:10:01.912164 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.912118 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xpmg4"] Jul 21 02:10:01.912307 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.912294 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wk5lt\"" Jul 21 02:10:01.912375 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.912305 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 21 02:10:01.913398 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.913381 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.913519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.913500 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.913519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.913515 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gt9sh\"" Jul 21 02:10:01.913636 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.913383 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 21 02:10:01.913636 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.913507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 21 02:10:01.913971 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.913955 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 21 02:10:01.914392 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.914251 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.914501 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.914483 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 21 02:10:01.914918 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.914900 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 21 02:10:01.914992 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.914926 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f4zk5\"" Jul 21 02:10:01.917224 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.917208 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 21 02:10:01.918040 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.917580 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.918198 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.918177 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.918331 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.918309 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 21 02:10:01.924469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.924445 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fb4748b6c-nrr7x"] Jul 21 02:10:01.924621 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.924600 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 21 02:10:01.925225 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.925206 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz"] Jul 21 02:10:01.925968 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.925929 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw"] Jul 21 02:10:01.926977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.926961 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f"] Jul 21 02:10:01.928327 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.928308 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rc8hc"] Jul 21 02:10:01.929000 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.928982 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nf96x"] Jul 21 02:10:01.932592 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.932573 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d48988cd-47vhx"] Jul 21 02:10:01.932683 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.932630 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz"] Jul 21 02:10:01.932876 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.932858 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:01.936290 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.936270 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw"] Jul 21 02:10:01.936400 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.936385 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:01.936873 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.936854 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 02:10:01.937560 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.937543 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 02:10:01.937801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.937564 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lx8r6\"" Jul 21 02:10:01.939171 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.939153 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-82r59"] Jul 21 02:10:01.939427 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.939409 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" Jul 21 02:10:01.940032 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.940014 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 02:10:01.940190 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.940038 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 02:10:01.940190 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.940114 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z5gpf\"" Jul 21 02:10:01.941310 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.941291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:01.944730 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.944712 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.945910 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.945883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9wsng\"" Jul 21 02:10:01.946126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.946037 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.946374 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.946337 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pzlzk\"" Jul 21 02:10:01.946458 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.946390 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 02:10:01.946803 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.945976 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 02:10:01.947028 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.946969 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 02:10:01.955336 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.954182 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz"] Jul 21 02:10:01.955336 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.954289 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9"] Jul 21 02:10:01.956061 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.956042 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82r59"] Jul 21 02:10:01.958873 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.958854 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx"] Jul 21 02:10:01.959053 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.959040 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw"] Jul 21 02:10:01.959935 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:01.959882 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nf96x"] Jul 21 02:10:02.013087 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g74jr\" (UniqueName: \"kubernetes.io/projected/db8870ee-dc43-42f9-97a1-cab13c5bcfbe-kube-api-access-g74jr\") pod \"network-check-source-7bc5b6bf85-8s7vw\" (UID: \"db8870ee-dc43-42f9-97a1-cab13c5bcfbe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" Jul 21 02:10:02.013271 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g586t\" (UniqueName: \"kubernetes.io/projected/164a09f1-2723-4759-9f5e-f358a2d2ab9a-kube-api-access-g586t\") pod \"ingress-canary-82r59\" (UID: \"164a09f1-2723-4759-9f5e-f358a2d2ab9a\") " pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:02.013271 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-image-registry-private-configuration\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.013271 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a561f6d-9ca6-4629-bf09-21cbe984406b-ca-trust-extracted\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.013271 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013209 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-installation-pull-secrets\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.013271 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/353548bf-2b65-42c8-8a63-b3aed85eea7d-config-volume\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.013502 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/a1d9f8d6-93dc-4eb7-8163-1888f1fa449c-kube-api-access-m6fxl\") pod \"volume-data-source-validator-78cf4c6f6-njk5f\" (UID: \"a1d9f8d6-93dc-4eb7-8163-1888f1fa449c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" Jul 21 02:10:02.013502 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjp5k\" (UniqueName: \"kubernetes.io/projected/b6a456e9-68d0-41fe-8000-01b00722f2f8-kube-api-access-fjp5k\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.013502 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013437 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9sxh\" (UniqueName: \"kubernetes.io/projected/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-kube-api-access-w9sxh\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.013502 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe890ada-031a-4051-b343-05fa32dadc64-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.013502 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013498 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmtrm\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-kube-api-access-cmtrm\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd6b434b-ab4b-44ee-b840-32249baf5b53-serving-cert\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-certificates\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013618 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1612e1fc-af23-4cb9-8539-184a90640300-serving-cert\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/353548bf-2b65-42c8-8a63-b3aed85eea7d-tmp-dir\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.013731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013723 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-bound-sa-token\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mtgt\" (UniqueName: \"kubernetes.io/projected/bd6b434b-ab4b-44ee-b840-32249baf5b53-kube-api-access-4mtgt\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-stats-auth\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-default-certificate\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-trusted-ca\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smnx8\" (UniqueName: \"kubernetes.io/projected/e1592f05-5da8-4d01-8a7f-989855bef45a-kube-api-access-smnx8\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.013982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f96gw\" (UniqueName: \"kubernetes.io/projected/1612e1fc-af23-4cb9-8539-184a90640300-kube-api-access-f96gw\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl96r\" (UniqueName: \"kubernetes.io/projected/353548bf-2b65-42c8-8a63-b3aed85eea7d-kube-api-access-pl96r\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.014082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/164a09f1-2723-4759-9f5e-f358a2d2ab9a-cert\") pod \"ingress-canary-82r59\" (UID: \"164a09f1-2723-4759-9f5e-f358a2d2ab9a\") " pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014092 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5f97723-7100-417b-bf2e-a686913b1f61-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd6b434b-ab4b-44ee-b840-32249baf5b53-trusted-ca\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xxsd\" (UniqueName: \"kubernetes.io/projected/9c35362b-794d-4372-9acf-228dfbae4c87-kube-api-access-4xxsd\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd6b434b-ab4b-44ee-b840-32249baf5b53-config\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014289 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1612e1fc-af23-4cb9-8539-184a90640300-snapshots\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6a456e9-68d0-41fe-8000-01b00722f2f8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1612e1fc-af23-4cb9-8539-184a90640300-tmp\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014368 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1612e1fc-af23-4cb9-8539-184a90640300-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014427 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqjng\" (UniqueName: \"kubernetes.io/projected/fe890ada-031a-4051-b343-05fa32dadc64-kube-api-access-xqjng\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6a456e9-68d0-41fe-8000-01b00722f2f8-config\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.014520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.014481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1612e1fc-af23-4cb9-8539-184a90640300-service-ca-bundle\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.114994 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.114904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9sxh\" (UniqueName: \"kubernetes.io/projected/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-kube-api-access-w9sxh\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.114994 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.114943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe890ada-031a-4051-b343-05fa32dadc64-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.114994 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.114970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmtrm\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-kube-api-access-cmtrm\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd6b434b-ab4b-44ee-b840-32249baf5b53-serving-cert\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115028 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115048 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-certificates\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1612e1fc-af23-4cb9-8539-184a90640300-serving-cert\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115133 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/353548bf-2b65-42c8-8a63-b3aed85eea7d-tmp-dir\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-bound-sa-token\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mtgt\" (UniqueName: \"kubernetes.io/projected/bd6b434b-ab4b-44ee-b840-32249baf5b53-kube-api-access-4mtgt\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-stats-auth\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115349 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-default-certificate\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.115391 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 02:10:02.116519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-trusted-ca\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smnx8\" (UniqueName: \"kubernetes.io/projected/e1592f05-5da8-4d01-8a7f-989855bef45a-kube-api-access-smnx8\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f96gw\" (UniqueName: \"kubernetes.io/projected/1612e1fc-af23-4cb9-8539-184a90640300-kube-api-access-f96gw\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl96r\" (UniqueName: \"kubernetes.io/projected/353548bf-2b65-42c8-8a63-b3aed85eea7d-kube-api-access-pl96r\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/164a09f1-2723-4759-9f5e-f358a2d2ab9a-cert\") pod \"ingress-canary-82r59\" (UID: \"164a09f1-2723-4759-9f5e-f358a2d2ab9a\") " pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115565 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5f97723-7100-417b-bf2e-a686913b1f61-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115613 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd6b434b-ab4b-44ee-b840-32249baf5b53-trusted-ca\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xxsd\" (UniqueName: \"kubernetes.io/projected/9c35362b-794d-4372-9acf-228dfbae4c87-kube-api-access-4xxsd\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd6b434b-ab4b-44ee-b840-32249baf5b53-config\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.115408 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb4748b6c-nrr7x: secret "image-registry-tls" not found Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1612e1fc-af23-4cb9-8539-184a90640300-snapshots\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.115762 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls podName:5a561f6d-9ca6-4629-bf09-21cbe984406b nodeName:}" failed. No retries permitted until 2026-07-21 02:10:02.61574754 +0000 UTC m=+35.538426646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls") pod "image-registry-6fb4748b6c-nrr7x" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b") : secret "image-registry-tls" not found Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115788 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6a456e9-68d0-41fe-8000-01b00722f2f8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.117136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115823 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1612e1fc-af23-4cb9-8539-184a90640300-tmp\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1612e1fc-af23-4cb9-8539-184a90640300-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqjng\" (UniqueName: \"kubernetes.io/projected/fe890ada-031a-4051-b343-05fa32dadc64-kube-api-access-xqjng\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6a456e9-68d0-41fe-8000-01b00722f2f8-config\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1612e1fc-af23-4cb9-8539-184a90640300-service-ca-bundle\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115913 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g74jr\" (UniqueName: \"kubernetes.io/projected/db8870ee-dc43-42f9-97a1-cab13c5bcfbe-kube-api-access-g74jr\") pod \"network-check-source-7bc5b6bf85-8s7vw\" (UID: \"db8870ee-dc43-42f9-97a1-cab13c5bcfbe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g586t\" (UniqueName: \"kubernetes.io/projected/164a09f1-2723-4759-9f5e-f358a2d2ab9a-kube-api-access-g586t\") pod \"ingress-canary-82r59\" (UID: \"164a09f1-2723-4759-9f5e-f358a2d2ab9a\") " pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115946 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-certificates\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.115414 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.115994 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls podName:e1592f05-5da8-4d01-8a7f-989855bef45a nodeName:}" failed. No retries permitted until 2026-07-21 02:10:02.615983365 +0000 UTC m=+35.538662465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-x45vz" (UID: "e1592f05-5da8-4d01-8a7f-989855bef45a") : secret "samples-operator-tls" not found Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.115561 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.116031 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls podName:353548bf-2b65-42c8-8a63-b3aed85eea7d nodeName:}" failed. No retries permitted until 2026-07-21 02:10:02.616019899 +0000 UTC m=+35.538698988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls") pod "dns-default-nf96x" (UID: "353548bf-2b65-42c8-8a63-b3aed85eea7d") : secret "dns-default-metrics-tls" not found Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.116881 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1612e1fc-af23-4cb9-8539-184a90640300-snapshots\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.117317 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e5f97723-7100-417b-bf2e-a686913b1f61-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.117448 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:02.617431074 +0000 UTC m=+35.540110182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : configmap references non-existent config key: service-ca.crt Jul 21 02:10:02.117840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.117590 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b6a456e9-68d0-41fe-8000-01b00722f2f8-config\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.118570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.117774 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bd6b434b-ab4b-44ee-b840-32249baf5b53-trusted-ca\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.118570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.118025 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1612e1fc-af23-4cb9-8539-184a90640300-tmp\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.118570 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.118130 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:02.118570 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.118196 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls podName:fe890ada-031a-4051-b343-05fa32dadc64 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:02.618179493 +0000 UTC m=+35.540858578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-csxl9" (UID: "fe890ada-031a-4051-b343-05fa32dadc64") : secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:02.118915 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.118887 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-trusted-ca\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.119017 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.118979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/fe890ada-031a-4051-b343-05fa32dadc64-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.119124 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.119105 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 02:10:02.119202 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.119160 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:02.619145176 +0000 UTC m=+35.541824278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : secret "router-metrics-certs-default" not found Jul 21 02:10:02.119278 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.119240 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.119373 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.119353 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 02:10:02.119442 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.119415 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert podName:e5f97723-7100-417b-bf2e-a686913b1f61 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:02.61940073 +0000 UTC m=+35.542079830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xf9hz" (UID: "e5f97723-7100-417b-bf2e-a686913b1f61") : secret "networking-console-plugin-cert" not found Jul 21 02:10:02.119550 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.115949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-image-registry-private-configuration\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.119550 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.119543 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd6b434b-ab4b-44ee-b840-32249baf5b53-config\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.119667 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.119584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a561f6d-9ca6-4629-bf09-21cbe984406b-ca-trust-extracted\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.119667 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.119614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-installation-pull-secrets\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.119765 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.119668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/353548bf-2b65-42c8-8a63-b3aed85eea7d-config-volume\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.119765 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.119695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/a1d9f8d6-93dc-4eb7-8163-1888f1fa449c-kube-api-access-m6fxl\") pod \"volume-data-source-validator-78cf4c6f6-njk5f\" (UID: \"a1d9f8d6-93dc-4eb7-8163-1888f1fa449c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" Jul 21 02:10:02.119765 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.119724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjp5k\" (UniqueName: \"kubernetes.io/projected/b6a456e9-68d0-41fe-8000-01b00722f2f8-kube-api-access-fjp5k\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.120164 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.120141 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1612e1fc-af23-4cb9-8539-184a90640300-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.120447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.120418 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6a456e9-68d0-41fe-8000-01b00722f2f8-serving-cert\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.120697 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.120658 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd6b434b-ab4b-44ee-b840-32249baf5b53-serving-cert\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.120961 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.120938 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/353548bf-2b65-42c8-8a63-b3aed85eea7d-tmp-dir\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.122187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.121515 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a561f6d-9ca6-4629-bf09-21cbe984406b-ca-trust-extracted\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.122187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.121889 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.122187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.122005 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/353548bf-2b65-42c8-8a63-b3aed85eea7d-config-volume\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.122187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.122051 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1612e1fc-af23-4cb9-8539-184a90640300-serving-cert\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.122187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.122152 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1612e1fc-af23-4cb9-8539-184a90640300-service-ca-bundle\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.122805 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.122769 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-stats-auth\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.123447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.123403 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-default-certificate\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.124391 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.124333 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/164a09f1-2723-4759-9f5e-f358a2d2ab9a-cert\") pod \"ingress-canary-82r59\" (UID: \"164a09f1-2723-4759-9f5e-f358a2d2ab9a\") " pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:02.124565 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.124526 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-installation-pull-secrets\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.124565 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.124526 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-image-registry-private-configuration\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.125140 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.125119 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:10:02.125275 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.125236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:10:02.125622 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.125532 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:10:02.128502 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.128390 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mtgt\" (UniqueName: \"kubernetes.io/projected/bd6b434b-ab4b-44ee-b840-32249baf5b53-kube-api-access-4mtgt\") pod \"console-operator-565b7b569d-xpmg4\" (UID: \"bd6b434b-ab4b-44ee-b840-32249baf5b53\") " pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.128691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.128650 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9sxh\" (UniqueName: \"kubernetes.io/projected/1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60-kube-api-access-w9sxh\") pod \"kube-storage-version-migrator-operator-7658d9b749-hb4hw\" (UID: \"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.129409 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.129178 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smnx8\" (UniqueName: \"kubernetes.io/projected/e1592f05-5da8-4d01-8a7f-989855bef45a-kube-api-access-smnx8\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:02.130457 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.129891 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gcvct\"" Jul 21 02:10:02.130457 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.130284 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 02:10:02.130649 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.130627 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 02:10:02.130926 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.130713 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2zscq\"" Jul 21 02:10:02.130926 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.130785 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl96r\" (UniqueName: \"kubernetes.io/projected/353548bf-2b65-42c8-8a63-b3aed85eea7d-kube-api-access-pl96r\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.132577 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.131841 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqjng\" (UniqueName: \"kubernetes.io/projected/fe890ada-031a-4051-b343-05fa32dadc64-kube-api-access-xqjng\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.132577 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.132332 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f96gw\" (UniqueName: \"kubernetes.io/projected/1612e1fc-af23-4cb9-8539-184a90640300-kube-api-access-f96gw\") pod \"insights-operator-555d9d7885-rc8hc\" (UID: \"1612e1fc-af23-4cb9-8539-184a90640300\") " pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.132577 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.132381 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-bound-sa-token\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.133280 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.133181 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmtrm\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-kube-api-access-cmtrm\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.133633 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.133596 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g74jr\" (UniqueName: \"kubernetes.io/projected/db8870ee-dc43-42f9-97a1-cab13c5bcfbe-kube-api-access-g74jr\") pod \"network-check-source-7bc5b6bf85-8s7vw\" (UID: \"db8870ee-dc43-42f9-97a1-cab13c5bcfbe\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" Jul 21 02:10:02.134533 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.134517 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xxsd\" (UniqueName: \"kubernetes.io/projected/9c35362b-794d-4372-9acf-228dfbae4c87-kube-api-access-4xxsd\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.138719 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.138678 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjp5k\" (UniqueName: \"kubernetes.io/projected/b6a456e9-68d0-41fe-8000-01b00722f2f8-kube-api-access-fjp5k\") pod \"service-ca-operator-5bcbc94c78-hx6nx\" (UID: \"b6a456e9-68d0-41fe-8000-01b00722f2f8\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.138909 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.138888 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6fxl\" (UniqueName: \"kubernetes.io/projected/a1d9f8d6-93dc-4eb7-8163-1888f1fa449c-kube-api-access-m6fxl\") pod \"volume-data-source-validator-78cf4c6f6-njk5f\" (UID: \"a1d9f8d6-93dc-4eb7-8163-1888f1fa449c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" Jul 21 02:10:02.138909 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.138900 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g586t\" (UniqueName: \"kubernetes.io/projected/164a09f1-2723-4759-9f5e-f358a2d2ab9a-kube-api-access-g586t\") pod \"ingress-canary-82r59\" (UID: \"164a09f1-2723-4759-9f5e-f358a2d2ab9a\") " pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:02.209872 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.209831 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" Jul 21 02:10:02.222327 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.222292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:02.238385 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.238348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" Jul 21 02:10:02.245446 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.245419 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" Jul 21 02:10:02.265642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.265605 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-rc8hc" Jul 21 02:10:02.294941 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.294910 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" Jul 21 02:10:02.299949 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.299926 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82r59" Jul 21 02:10:02.599674 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.599531 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw"] Jul 21 02:10:02.604175 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:02.604138 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb8870ee_dc43_42f9_97a1_cab13c5bcfbe.slice/crio-b9d5c6704e4b6c6b5dcf63673419b69e036c71c2e05c96748d8115d746b16064 WatchSource:0}: Error finding container b9d5c6704e4b6c6b5dcf63673419b69e036c71c2e05c96748d8115d746b16064: Status 404 returned error can't find the container with id b9d5c6704e4b6c6b5dcf63673419b69e036c71c2e05c96748d8115d746b16064 Jul 21 02:10:02.607458 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.607369 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f"] Jul 21 02:10:02.610171 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.610096 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw"] Jul 21 02:10:02.624748 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.624712 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:02.624950 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.624813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.625032 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.624859 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:02.625032 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.624900 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 02:10:02.625032 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.624998 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 02:10:02.625032 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.624964 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:03.624942099 +0000 UTC m=+36.547621204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : configmap references non-existent config key: service-ca.crt Jul 21 02:10:02.625160 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625055 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert podName:e5f97723-7100-417b-bf2e-a686913b1f61 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:03.625035041 +0000 UTC m=+36.547714133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xf9hz" (UID: "e5f97723-7100-417b-bf2e-a686913b1f61") : secret "networking-console-plugin-cert" not found Jul 21 02:10:02.625160 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625075 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:03.625064929 +0000 UTC m=+36.547744025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : secret "router-metrics-certs-default" not found Jul 21 02:10:02.625160 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.625138 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:02.625324 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.625303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:02.625385 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.625347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:02.625421 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.625375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:02.625483 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625465 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 02:10:02.625519 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625498 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 02:10:02.625519 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625512 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb4748b6c-nrr7x: secret "image-registry-tls" not found Jul 21 02:10:02.625588 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625521 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 02:10:02.625588 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625499 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:02.625588 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625528 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls podName:e1592f05-5da8-4d01-8a7f-989855bef45a nodeName:}" failed. No retries permitted until 2026-07-21 02:10:03.62551317 +0000 UTC m=+36.548192257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-x45vz" (UID: "e1592f05-5da8-4d01-8a7f-989855bef45a") : secret "samples-operator-tls" not found Jul 21 02:10:02.625588 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625584 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls podName:5a561f6d-9ca6-4629-bf09-21cbe984406b nodeName:}" failed. No retries permitted until 2026-07-21 02:10:03.625567602 +0000 UTC m=+36.548246697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls") pod "image-registry-6fb4748b6c-nrr7x" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b") : secret "image-registry-tls" not found Jul 21 02:10:02.625703 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625600 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls podName:fe890ada-031a-4051-b343-05fa32dadc64 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:03.62559141 +0000 UTC m=+36.548270700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-csxl9" (UID: "fe890ada-031a-4051-b343-05fa32dadc64") : secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:02.625703 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:02.625623 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls podName:353548bf-2b65-42c8-8a63-b3aed85eea7d nodeName:}" failed. No retries permitted until 2026-07-21 02:10:03.6256147 +0000 UTC m=+36.548293787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls") pod "dns-default-nf96x" (UID: "353548bf-2b65-42c8-8a63-b3aed85eea7d") : secret "dns-default-metrics-tls" not found Jul 21 02:10:02.636149 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.636076 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82r59"] Jul 21 02:10:02.640670 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.640651 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-rc8hc"] Jul 21 02:10:02.642269 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.642229 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-xpmg4"] Jul 21 02:10:02.651457 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:02.651420 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx"] Jul 21 02:10:02.654232 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:02.654205 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b72ee4e_d4b1_40b5_abe8_aa0cbabb6e60.slice/crio-512ba44392da125db85134fd56949583e8c5f367b2f322ab91ba0e13e429883f WatchSource:0}: Error finding container 512ba44392da125db85134fd56949583e8c5f367b2f322ab91ba0e13e429883f: Status 404 returned error can't find the container with id 512ba44392da125db85134fd56949583e8c5f367b2f322ab91ba0e13e429883f Jul 21 02:10:02.655581 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:02.655556 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd6b434b_ab4b_44ee_b840_32249baf5b53.slice/crio-309e7be6d826ff892cedf81abef52b390af3b5bceb9c7e2dde2730967d238f88 WatchSource:0}: Error finding container 309e7be6d826ff892cedf81abef52b390af3b5bceb9c7e2dde2730967d238f88: Status 404 returned error can't find the container with id 309e7be6d826ff892cedf81abef52b390af3b5bceb9c7e2dde2730967d238f88 Jul 21 02:10:02.656137 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:02.656042 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d9f8d6_93dc_4eb7_8163_1888f1fa449c.slice/crio-f09cd017b3d5c3e00f9ded29e098e188d1f05e3d8e488a727ce816e179450773 WatchSource:0}: Error finding container f09cd017b3d5c3e00f9ded29e098e188d1f05e3d8e488a727ce816e179450773: Status 404 returned error can't find the container with id f09cd017b3d5c3e00f9ded29e098e188d1f05e3d8e488a727ce816e179450773 Jul 21 02:10:02.656705 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:02.656680 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a456e9_68d0_41fe_8000_01b00722f2f8.slice/crio-7fefa63f7a0f743504f23f537023e7dd54d072a90ea8d7acd7154665ad16113f WatchSource:0}: Error finding container 7fefa63f7a0f743504f23f537023e7dd54d072a90ea8d7acd7154665ad16113f: Status 404 returned error can't find the container with id 7fefa63f7a0f743504f23f537023e7dd54d072a90ea8d7acd7154665ad16113f Jul 21 02:10:03.491496 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.491388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" event={"ID":"a1d9f8d6-93dc-4eb7-8163-1888f1fa449c","Type":"ContainerStarted","Data":"f09cd017b3d5c3e00f9ded29e098e188d1f05e3d8e488a727ce816e179450773"} Jul 21 02:10:03.493862 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.493783 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" event={"ID":"b6a456e9-68d0-41fe-8000-01b00722f2f8","Type":"ContainerStarted","Data":"7fefa63f7a0f743504f23f537023e7dd54d072a90ea8d7acd7154665ad16113f"} Jul 21 02:10:03.495248 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.495178 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" event={"ID":"bd6b434b-ab4b-44ee-b840-32249baf5b53","Type":"ContainerStarted","Data":"309e7be6d826ff892cedf81abef52b390af3b5bceb9c7e2dde2730967d238f88"} Jul 21 02:10:03.496431 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.496362 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rc8hc" event={"ID":"1612e1fc-af23-4cb9-8539-184a90640300","Type":"ContainerStarted","Data":"c9f6f3a74217d443d462cdd907b65675859e9d953bee3acdfd4af1eaddccc4f1"} Jul 21 02:10:03.500964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.500937 2565 generic.go:356] "Generic (PLEG): container finished" podID="f8069911-9c1d-4284-b705-2a8574c285e6" containerID="808c9611a87504a6c2fbe3797d15d79cfa3eecf539b84bb7ead7a1f34b598d74" exitCode=0 Jul 21 02:10:03.501090 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.501005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerDied","Data":"808c9611a87504a6c2fbe3797d15d79cfa3eecf539b84bb7ead7a1f34b598d74"} Jul 21 02:10:03.508997 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.508940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" event={"ID":"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60","Type":"ContainerStarted","Data":"512ba44392da125db85134fd56949583e8c5f367b2f322ab91ba0e13e429883f"} Jul 21 02:10:03.512101 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.512042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" event={"ID":"db8870ee-dc43-42f9-97a1-cab13c5bcfbe","Type":"ContainerStarted","Data":"b9d5c6704e4b6c6b5dcf63673419b69e036c71c2e05c96748d8115d746b16064"} Jul 21 02:10:03.516844 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.516809 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82r59" event={"ID":"164a09f1-2723-4759-9f5e-f358a2d2ab9a","Type":"ContainerStarted","Data":"db29deeb001bbf1b22648515c285df4c18d53f6edd3c18aae6d10bb20a24d8a8"} Jul 21 02:10:03.638514 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.638235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:03.638621 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.638578 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:03.638749 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.638727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:03.638814 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.638767 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:03.638814 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.638795 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:03.640428 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.638824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:03.640428 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:03.638896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:03.640428 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.639126 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:05.639105771 +0000 UTC m=+38.561784859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : configmap references non-existent config key: service-ca.crt Jul 21 02:10:03.640428 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.639608 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 02:10:03.640428 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.639658 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:05.639642805 +0000 UTC m=+38.562321891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : secret "router-metrics-certs-default" not found Jul 21 02:10:03.640428 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.639720 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:03.640428 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.639753 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls podName:fe890ada-031a-4051-b343-05fa32dadc64 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:05.639742616 +0000 UTC m=+38.562421716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-csxl9" (UID: "fe890ada-031a-4051-b343-05fa32dadc64") : secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:03.650638 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.650608 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 02:10:03.650810 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.650796 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert podName:e5f97723-7100-417b-bf2e-a686913b1f61 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:05.650773794 +0000 UTC m=+38.573452893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xf9hz" (UID: "e5f97723-7100-417b-bf2e-a686913b1f61") : secret "networking-console-plugin-cert" not found Jul 21 02:10:03.651150 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.651127 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 02:10:03.651228 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.651180 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls podName:e1592f05-5da8-4d01-8a7f-989855bef45a nodeName:}" failed. No retries permitted until 2026-07-21 02:10:05.651165912 +0000 UTC m=+38.573845011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-x45vz" (UID: "e1592f05-5da8-4d01-8a7f-989855bef45a") : secret "samples-operator-tls" not found Jul 21 02:10:03.651334 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.651272 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 02:10:03.651334 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.651315 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls podName:353548bf-2b65-42c8-8a63-b3aed85eea7d nodeName:}" failed. No retries permitted until 2026-07-21 02:10:05.651302284 +0000 UTC m=+38.573981382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls") pod "dns-default-nf96x" (UID: "353548bf-2b65-42c8-8a63-b3aed85eea7d") : secret "dns-default-metrics-tls" not found Jul 21 02:10:03.651439 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.651343 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 02:10:03.651439 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.651367 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb4748b6c-nrr7x: secret "image-registry-tls" not found Jul 21 02:10:03.651439 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:03.651435 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls podName:5a561f6d-9ca6-4629-bf09-21cbe984406b nodeName:}" failed. No retries permitted until 2026-07-21 02:10:05.651414067 +0000 UTC m=+38.574093192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls") pod "image-registry-6fb4748b6c-nrr7x" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b") : secret "image-registry-tls" not found Jul 21 02:10:04.540400 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:04.539084 2565 generic.go:356] "Generic (PLEG): container finished" podID="f8069911-9c1d-4284-b705-2a8574c285e6" containerID="abcf7a6bee8413a547d0ea04571cfaa367696372fc81c10bcde85c81326d5293" exitCode=0 Jul 21 02:10:04.540400 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:04.539164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerDied","Data":"abcf7a6bee8413a547d0ea04571cfaa367696372fc81c10bcde85c81326d5293"} Jul 21 02:10:05.547224 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.547163 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" event={"ID":"f8069911-9c1d-4284-b705-2a8574c285e6","Type":"ContainerStarted","Data":"019910cdb7204b020be890e681795aa6c9fe22800134c35ae5005d47abc1071a"} Jul 21 02:10:05.577543 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.577424 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v4wk6" podStartSLOduration=7.47135125 podStartE2EDuration="37.577400785s" totalImagesPullingTime="30.106049535s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:05.575698654 +0000 UTC m=+38.498377787" watchObservedRunningTime="2026-07-21 02:10:05.577400785 +0000 UTC m=+38.500079898" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.661684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.661813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.661843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.661874 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.661889 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.661954 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls podName:e1592f05-5da8-4d01-8a7f-989855bef45a nodeName:}" failed. No retries permitted until 2026-07-21 02:10:09.661935473 +0000 UTC m=+42.584614581 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-x45vz" (UID: "e1592f05-5da8-4d01-8a7f-989855bef45a") : secret "samples-operator-tls" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.661988 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.662022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662057 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls podName:353548bf-2b65-42c8-8a63-b3aed85eea7d nodeName:}" failed. No retries permitted until 2026-07-21 02:10:09.662038334 +0000 UTC m=+42.584717441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls") pod "dns-default-nf96x" (UID: "353548bf-2b65-42c8-8a63-b3aed85eea7d") : secret "dns-default-metrics-tls" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.662110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662155 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.662178 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662196 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert podName:e5f97723-7100-417b-bf2e-a686913b1f61 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:09.662182012 +0000 UTC m=+42.584861104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xf9hz" (UID: "e5f97723-7100-417b-bf2e-a686913b1f61") : secret "networking-console-plugin-cert" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662248 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.661994 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 02:10:05.662463 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662332 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb4748b6c-nrr7x: secret "image-registry-tls" not found Jul 21 02:10:05.663198 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662314 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls podName:fe890ada-031a-4051-b343-05fa32dadc64 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:09.662302035 +0000 UTC m=+42.584981147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-csxl9" (UID: "fe890ada-031a-4051-b343-05fa32dadc64") : secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:05.663198 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662379 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:09.662364423 +0000 UTC m=+42.585043512 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : configmap references non-existent config key: service-ca.crt Jul 21 02:10:05.663198 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662401 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls podName:5a561f6d-9ca6-4629-bf09-21cbe984406b nodeName:}" failed. No retries permitted until 2026-07-21 02:10:09.662392477 +0000 UTC m=+42.585071575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls") pod "image-registry-6fb4748b6c-nrr7x" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b") : secret "image-registry-tls" not found Jul 21 02:10:05.663198 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662439 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 02:10:05.663198 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:05.662474 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:09.662463191 +0000 UTC m=+42.585142298 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : secret "router-metrics-certs-default" not found Jul 21 02:10:05.733757 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.733678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:05.822980 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:05.822923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:07.096230 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:07.096191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:07.200711 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:07.200667 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:07.442794 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:07.442704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:07.552925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:07.552891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:08.274736 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:08.274697 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:08.341532 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:08.341499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:09.704015 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:09.703966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:09.704015 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:09.704011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:09.704030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:09.704052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:09.704080 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:09.704110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704134 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:09.704147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704170 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704138 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704200 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704208 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls podName:e1592f05-5da8-4d01-8a7f-989855bef45a nodeName:}" failed. No retries permitted until 2026-07-21 02:10:17.704189069 +0000 UTC m=+50.626868166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-x45vz" (UID: "e1592f05-5da8-4d01-8a7f-989855bef45a") : secret "samples-operator-tls" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704209 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb4748b6c-nrr7x: secret "image-registry-tls" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704285 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704290 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:17.704249622 +0000 UTC m=+50.626928720 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : configmap references non-existent config key: service-ca.crt Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704139 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704310 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls podName:5a561f6d-9ca6-4629-bf09-21cbe984406b nodeName:}" failed. No retries permitted until 2026-07-21 02:10:17.704299129 +0000 UTC m=+50.626978218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls") pod "image-registry-6fb4748b6c-nrr7x" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b") : secret "image-registry-tls" not found Jul 21 02:10:09.704528 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704326 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert podName:e5f97723-7100-417b-bf2e-a686913b1f61 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:17.704318246 +0000 UTC m=+50.626997343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xf9hz" (UID: "e5f97723-7100-417b-bf2e-a686913b1f61") : secret "networking-console-plugin-cert" not found Jul 21 02:10:09.704989 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704358 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:17.704352084 +0000 UTC m=+50.627031170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : secret "router-metrics-certs-default" not found Jul 21 02:10:09.704989 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704368 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls podName:fe890ada-031a-4051-b343-05fa32dadc64 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:17.704363134 +0000 UTC m=+50.627042219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-csxl9" (UID: "fe890ada-031a-4051-b343-05fa32dadc64") : secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:09.704989 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:09.704377 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls podName:353548bf-2b65-42c8-8a63-b3aed85eea7d nodeName:}" failed. No retries permitted until 2026-07-21 02:10:17.704373281 +0000 UTC m=+50.627052367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls") pod "dns-default-nf96x" (UID: "353548bf-2b65-42c8-8a63-b3aed85eea7d") : secret "dns-default-metrics-tls" not found Jul 21 02:10:10.165019 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.164993 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:10.266422 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.266395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:10.566850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.566565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82r59" event={"ID":"164a09f1-2723-4759-9f5e-f358a2d2ab9a","Type":"ContainerStarted","Data":"1b773e4f0248f8c928c20a0ee472a048021f0f763416dc811a71d65322e49290"} Jul 21 02:10:10.568785 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.568755 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" event={"ID":"a1d9f8d6-93dc-4eb7-8163-1888f1fa449c","Type":"ContainerStarted","Data":"f07de5bd241153f61db971f95cff6d583f32ff24f5f2a28628e78072af74dbde"} Jul 21 02:10:10.571503 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.570698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" event={"ID":"b6a456e9-68d0-41fe-8000-01b00722f2f8","Type":"ContainerStarted","Data":"b85e5af049027eddccc5f4e1046b71e93c02853916d579b0cff41affd9847f71"} Jul 21 02:10:10.573035 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.573012 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/0.log" Jul 21 02:10:10.573134 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.573048 2565 generic.go:356] "Generic (PLEG): container finished" podID="bd6b434b-ab4b-44ee-b840-32249baf5b53" containerID="5cdf5b201b996815c3053f6509ea9edbe7b06bffcdfc4adeac9ec8de5861f9a4" exitCode=255 Jul 21 02:10:10.573350 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.573186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" event={"ID":"bd6b434b-ab4b-44ee-b840-32249baf5b53","Type":"ContainerDied","Data":"5cdf5b201b996815c3053f6509ea9edbe7b06bffcdfc4adeac9ec8de5861f9a4"} Jul 21 02:10:10.574015 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.573702 2565 scope.go:117] "RemoveContainer" containerID="5cdf5b201b996815c3053f6509ea9edbe7b06bffcdfc4adeac9ec8de5861f9a4" Jul 21 02:10:10.577463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.577437 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rc8hc" event={"ID":"1612e1fc-af23-4cb9-8539-184a90640300","Type":"ContainerStarted","Data":"1137e313ae8e0e31d476cfc671ebd12ebf746ecf7269cac720bc206ab8929a07"} Jul 21 02:10:10.579020 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.578993 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" event={"ID":"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60","Type":"ContainerStarted","Data":"f48a0f4e91e6fdf845f210392b1444c28e9da2423207a08c724ae18480742e71"} Jul 21 02:10:10.580901 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.580875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" event={"ID":"db8870ee-dc43-42f9-97a1-cab13c5bcfbe","Type":"ContainerStarted","Data":"09183c61aba0ea0d654a43ddd2942186cf1d7e3260a24222b33b4536d2221c0b"} Jul 21 02:10:10.588654 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.588282 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-82r59" podStartSLOduration=2.04348 podStartE2EDuration="9.588249311s" totalImagesPullingTime="7.544769311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:10.587390268 +0000 UTC m=+43.510069399" watchObservedRunningTime="2026-07-21 02:10:10.588249311 +0000 UTC m=+43.510928397" Jul 21 02:10:10.607225 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.606666 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8s7vw" podStartSLOduration=33.014544319 podStartE2EDuration="40.606644255s" totalImagesPullingTime="7.592099936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:10.60568683 +0000 UTC m=+43.528365939" watchObservedRunningTime="2026-07-21 02:10:10.606644255 +0000 UTC m=+43.529323367" Jul 21 02:10:10.633526 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.633110 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-njk5f" podStartSLOduration=33.222673325 podStartE2EDuration="40.633083501s" totalImagesPullingTime="7.410410176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:10.629209676 +0000 UTC m=+43.551888785" watchObservedRunningTime="2026-07-21 02:10:10.633083501 +0000 UTC m=+43.555762601" Jul 21 02:10:10.674467 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.674403 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" podStartSLOduration=33.131443225 podStartE2EDuration="40.674380051s" totalImagesPullingTime="7.542936826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:10.672989839 +0000 UTC m=+43.595668948" watchObservedRunningTime="2026-07-21 02:10:10.674380051 +0000 UTC m=+43.597059158" Jul 21 02:10:10.731286 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.730655 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" podStartSLOduration=33.1926714 podStartE2EDuration="40.730632006s" totalImagesPullingTime="7.537960606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:10.702923347 +0000 UTC m=+43.625602454" watchObservedRunningTime="2026-07-21 02:10:10.730632006 +0000 UTC m=+43.653311114" Jul 21 02:10:10.753744 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.753656 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:10.855309 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.855203 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:10.961618 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:10.961564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.053469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.053424 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.253462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.253379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.354943 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.354911 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.456220 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.456183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.522462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.522432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.593513 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.593481 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/1.log" Jul 21 02:10:11.594010 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.593987 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/0.log" Jul 21 02:10:11.594154 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.594033 2565 generic.go:356] "Generic (PLEG): container finished" podID="bd6b434b-ab4b-44ee-b840-32249baf5b53" containerID="ee0cb19244129860860be21005fe23fd8b39cf44563dab060327777efd1ea977" exitCode=255 Jul 21 02:10:11.594154 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.594139 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" event={"ID":"bd6b434b-ab4b-44ee-b840-32249baf5b53","Type":"ContainerDied","Data":"ee0cb19244129860860be21005fe23fd8b39cf44563dab060327777efd1ea977"} Jul 21 02:10:11.594292 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.594221 2565 scope.go:117] "RemoveContainer" containerID="5cdf5b201b996815c3053f6509ea9edbe7b06bffcdfc4adeac9ec8de5861f9a4" Jul 21 02:10:11.595083 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.595064 2565 scope.go:117] "RemoveContainer" containerID="ee0cb19244129860860be21005fe23fd8b39cf44563dab060327777efd1ea977" Jul 21 02:10:11.596972 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:11.596929 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xpmg4_openshift-console-operator(bd6b434b-ab4b-44ee-b840-32249baf5b53)\"" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" podUID="bd6b434b-ab4b-44ee-b840-32249baf5b53" Jul 21 02:10:11.617724 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.617673 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-rc8hc" podStartSLOduration=34.082474544 podStartE2EDuration="41.6176538s" totalImagesPullingTime="7.535179256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:10.730833465 +0000 UTC m=+43.653512574" watchObservedRunningTime="2026-07-21 02:10:11.6176538 +0000 UTC m=+44.540332907" Jul 21 02:10:11.769742 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.769700 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gj95b"] Jul 21 02:10:11.798466 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.798379 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gj95b"] Jul 21 02:10:11.798617 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.798516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:11.803314 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.803276 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 02:10:11.803568 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.803553 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 02:10:11.803665 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.803588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wj6qb\"" Jul 21 02:10:11.839566 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.839531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.925994 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.925962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r547g\" (UniqueName: \"kubernetes.io/projected/6481f074-d4d5-477e-8862-78d9812258e0-kube-api-access-r547g\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:11.926166 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.926096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:11.926166 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.926143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6481f074-d4d5-477e-8862-78d9812258e0-crio-socket\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:11.926252 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.926172 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:11.926300 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.926246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6481f074-d4d5-477e-8862-78d9812258e0-data-volume\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:11.931291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.931238 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:11.988989 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:11.988953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:12.027195 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.027151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.027392 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.027243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6481f074-d4d5-477e-8862-78d9812258e0-data-volume\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.027392 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.027308 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r547g\" (UniqueName: \"kubernetes.io/projected/6481f074-d4d5-477e-8862-78d9812258e0-kube-api-access-r547g\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.027392 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.027353 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 02:10:12.027512 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.027398 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.027512 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.027426 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:12.52740641 +0000 UTC m=+45.450085509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : secret "insights-runtime-extractor-tls" not found Jul 21 02:10:12.027512 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.027447 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 02:10:12.027512 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.027485 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6481f074-d4d5-477e-8862-78d9812258e0-crio-socket\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.027665 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.027494 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:12.527477899 +0000 UTC m=+45.450156984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : configmap "kube-rbac-proxy" not found Jul 21 02:10:12.027665 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.027631 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6481f074-d4d5-477e-8862-78d9812258e0-data-volume\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.027665 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.027635 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6481f074-d4d5-477e-8862-78d9812258e0-crio-socket\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.038491 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.038461 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r547g\" (UniqueName: \"kubernetes.io/projected/6481f074-d4d5-477e-8862-78d9812258e0-kube-api-access-r547g\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.138974 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.138891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:12.223415 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.223379 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:12.223593 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.223438 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:12.248959 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.248914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:12.533160 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.533122 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.533350 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.533310 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 02:10:12.533350 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.533337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:12.533441 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.533406 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:13.533385517 +0000 UTC m=+46.456064606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : secret "insights-runtime-extractor-tls" not found Jul 21 02:10:12.533441 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.533419 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 02:10:12.533511 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.533452 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:13.533441769 +0000 UTC m=+46.456120854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : configmap "kube-rbac-proxy" not found Jul 21 02:10:12.601172 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.601142 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/1.log" Jul 21 02:10:12.601506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:12.601492 2565 scope.go:117] "RemoveContainer" containerID="ee0cb19244129860860be21005fe23fd8b39cf44563dab060327777efd1ea977" Jul 21 02:10:12.601661 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:12.601644 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xpmg4_openshift-console-operator(bd6b434b-ab4b-44ee-b840-32249baf5b53)\"" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" podUID="bd6b434b-ab4b-44ee-b840-32249baf5b53" Jul 21 02:10:13.542126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:13.542089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:13.542526 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:13.542141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:13.542526 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:13.542200 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 02:10:13.542526 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:13.542287 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:15.542248364 +0000 UTC m=+48.464927454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : configmap "kube-rbac-proxy" not found Jul 21 02:10:13.542526 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:13.542332 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 02:10:13.542526 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:13.542389 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:15.542375356 +0000 UTC m=+48.465054444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : secret "insights-runtime-extractor-tls" not found Jul 21 02:10:13.604419 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:13.604390 2565 scope.go:117] "RemoveContainer" containerID="ee0cb19244129860860be21005fe23fd8b39cf44563dab060327777efd1ea977" Jul 21 02:10:13.604589 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:13.604543 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-xpmg4_openshift-console-operator(bd6b434b-ab4b-44ee-b840-32249baf5b53)\"" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" podUID="bd6b434b-ab4b-44ee-b840-32249baf5b53" Jul 21 02:10:13.805249 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:13.805149 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:13.878824 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:13.878784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:13.950201 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:13.950179 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zsfmr_0b15c5c6-0cb8-4289-975e-1bdb353d3354/dns-node-resolver/0.log" Jul 21 02:10:14.552326 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:14.552302 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-24cm6_d455697e-d0df-4cb5-b012-f9d13f779d14/node-ca/0.log" Jul 21 02:10:14.949540 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:14.949420 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:15.349065 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:15.349021 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82r59_164a09f1-2723-4759-9f5e-f358a2d2ab9a/serve-healthcheck-canary/0.log" Jul 21 02:10:15.561451 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:15.561415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:15.561810 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:15.561465 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:15.561810 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:15.561538 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 02:10:15.561810 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:15.561553 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 02:10:15.561810 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:15.561617 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:19.561601441 +0000 UTC m=+52.484280526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : configmap "kube-rbac-proxy" not found Jul 21 02:10:15.561810 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:15.561670 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:19.561663532 +0000 UTC m=+52.484342617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : secret "insights-runtime-extractor-tls" not found Jul 21 02:10:17.780423 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:17.780381 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:17.780444 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:17.780503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:17.780521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780524 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:17.780545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:17.780573 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780594 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:33.780573412 +0000 UTC m=+66.703252501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : secret "router-metrics-certs-default" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780615 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780630 2565 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780655 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780665 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780684 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fb4748b6c-nrr7x: secret "image-registry-tls" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:17.780658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780669 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls podName:e1592f05-5da8-4d01-8a7f-989855bef45a nodeName:}" failed. No retries permitted until 2026-07-21 02:10:33.780653615 +0000 UTC m=+66.703332714 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-x45vz" (UID: "e1592f05-5da8-4d01-8a7f-989855bef45a") : secret "samples-operator-tls" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780618 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780763 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert podName:e5f97723-7100-417b-bf2e-a686913b1f61 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:33.78075266 +0000 UTC m=+66.703431752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-xf9hz" (UID: "e5f97723-7100-417b-bf2e-a686913b1f61") : secret "networking-console-plugin-cert" not found Jul 21 02:10:17.780922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780778 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls podName:353548bf-2b65-42c8-8a63-b3aed85eea7d nodeName:}" failed. No retries permitted until 2026-07-21 02:10:33.780772896 +0000 UTC m=+66.703451981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls") pod "dns-default-nf96x" (UID: "353548bf-2b65-42c8-8a63-b3aed85eea7d") : secret "dns-default-metrics-tls" not found Jul 21 02:10:17.781502 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780795 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle podName:9c35362b-794d-4372-9acf-228dfbae4c87 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:33.78078582 +0000 UTC m=+66.703464905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle") pod "router-default-85d48988cd-47vhx" (UID: "9c35362b-794d-4372-9acf-228dfbae4c87") : configmap references non-existent config key: service-ca.crt Jul 21 02:10:17.781502 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780818 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls podName:5a561f6d-9ca6-4629-bf09-21cbe984406b nodeName:}" failed. No retries permitted until 2026-07-21 02:10:33.780809741 +0000 UTC m=+66.703488856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls") pod "image-registry-6fb4748b6c-nrr7x" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b") : secret "image-registry-tls" not found Jul 21 02:10:17.781502 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:17.780838 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls podName:fe890ada-031a-4051-b343-05fa32dadc64 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:33.780829566 +0000 UTC m=+66.703508655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-csxl9" (UID: "fe890ada-031a-4051-b343-05fa32dadc64") : secret "cluster-monitoring-operator-tls" not found Jul 21 02:10:18.177393 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:18.177310 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:18.370160 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:18.370125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:18.493130 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:18.493010 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:18.593819 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:18.593761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:18.693620 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:18.693586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:18.856500 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:18.856449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:19.269454 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:19.269416 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:19.597858 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:19.597760 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:19.598029 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:19.597930 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 02:10:19.598029 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:19.597970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:19.598029 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:19.598003 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls podName:6481f074-d4d5-477e-8862-78d9812258e0 nodeName:}" failed. No retries permitted until 2026-07-21 02:10:27.597975462 +0000 UTC m=+60.520654547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj95b" (UID: "6481f074-d4d5-477e-8862-78d9812258e0") : secret "insights-runtime-extractor-tls" not found Jul 21 02:10:19.598573 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:19.598552 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6481f074-d4d5-477e-8862-78d9812258e0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:19.678860 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:19.678819 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:20.475965 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:20.475880 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:20.877593 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:20.877550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:21.091192 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:21.091159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:21.277734 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:21.277691 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:21.476501 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:21.476457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:22.071702 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:22.071671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:22.273535 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:22.273502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:22.332323 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:22.332218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:22.871486 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:22.871432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:23.078689 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:23.078653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:23.478936 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:23.478879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:23.674918 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:23.674877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:23.775388 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:23.775338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:23.877451 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:23.877418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:24.076373 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:24.076292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:24.576112 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:24.576036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:24.868823 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:24.868744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:25.121170 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.121116 2565 scope.go:117] "RemoveContainer" containerID="ee0cb19244129860860be21005fe23fd8b39cf44563dab060327777efd1ea977" Jul 21 02:10:25.159835 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.159815 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:25.260448 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.260422 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:25.318830 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.318764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:25.474520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.474400 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:25.643288 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.643247 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:10:25.643647 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.643632 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/1.log" Jul 21 02:10:25.643693 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.643667 2565 generic.go:356] "Generic (PLEG): container finished" podID="bd6b434b-ab4b-44ee-b840-32249baf5b53" containerID="60ba1f70878e5c78939f8cb93725082d894590f40ceeaec7114bd7e8d41bfd83" exitCode=255 Jul 21 02:10:25.643731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.643708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" event={"ID":"bd6b434b-ab4b-44ee-b840-32249baf5b53","Type":"ContainerDied","Data":"60ba1f70878e5c78939f8cb93725082d894590f40ceeaec7114bd7e8d41bfd83"} Jul 21 02:10:25.643768 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.643757 2565 scope.go:117] "RemoveContainer" containerID="ee0cb19244129860860be21005fe23fd8b39cf44563dab060327777efd1ea977" Jul 21 02:10:25.644085 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.644070 2565 scope.go:117] "RemoveContainer" containerID="60ba1f70878e5c78939f8cb93725082d894590f40ceeaec7114bd7e8d41bfd83" Jul 21 02:10:25.644331 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:25.644309 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-xpmg4_openshift-console-operator(bd6b434b-ab4b-44ee-b840-32249baf5b53)\"" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" podUID="bd6b434b-ab4b-44ee-b840-32249baf5b53" Jul 21 02:10:25.671665 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:25.671620 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:26.074454 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:26.074413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:26.484804 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:26.484739 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ncdpg" Jul 21 02:10:26.647637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:26.647608 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:10:26.675645 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:26.675614 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:26.738985 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:26.738898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:27.066103 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:27.066055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:27.273720 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:27.273679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:27.677595 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:27.677547 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:27.679855 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:27.679832 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6481f074-d4d5-477e-8862-78d9812258e0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj95b\" (UID: \"6481f074-d4d5-477e-8862-78d9812258e0\") " pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:27.708947 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:27.708924 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gj95b" Jul 21 02:10:27.837781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:27.837760 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gj95b"] Jul 21 02:10:27.840117 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:27.840095 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6481f074_d4d5_477e_8862_78d9812258e0.slice/crio-c1a13fb1d65ba8b4425676844dd5d71e44c86e995d46e5b9cc9a8f6a99f21873 WatchSource:0}: Error finding container c1a13fb1d65ba8b4425676844dd5d71e44c86e995d46e5b9cc9a8f6a99f21873: Status 404 returned error can't find the container with id c1a13fb1d65ba8b4425676844dd5d71e44c86e995d46e5b9cc9a8f6a99f21873 Jul 21 02:10:27.878354 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:27.878326 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:28.473191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:28.473086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:28.658139 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:28.658103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj95b" event={"ID":"6481f074-d4d5-477e-8862-78d9812258e0","Type":"ContainerStarted","Data":"c1a13fb1d65ba8b4425676844dd5d71e44c86e995d46e5b9cc9a8f6a99f21873"} Jul 21 02:10:28.669612 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:28.669556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:28.877668 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:28.877636 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:29.083571 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:29.083531 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:32.223460 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.223421 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:32.223840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.223494 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:32.223888 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.223852 2565 scope.go:117] "RemoveContainer" containerID="60ba1f70878e5c78939f8cb93725082d894590f40ceeaec7114bd7e8d41bfd83" Jul 21 02:10:32.224064 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:32.224042 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-xpmg4_openshift-console-operator(bd6b434b-ab4b-44ee-b840-32249baf5b53)\"" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" podUID="bd6b434b-ab4b-44ee-b840-32249baf5b53" Jul 21 02:10:32.672521 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.672487 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj95b" event={"ID":"6481f074-d4d5-477e-8862-78d9812258e0","Type":"ContainerStarted","Data":"d89ec8baf75a3cd5057a70df6be46f3cae121213e43e06a6ca634e1e3376be57"} Jul 21 02:10:32.826297 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.826201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:10:32.826436 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.826419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:10:32.826471 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.826442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:10:32.828850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.828818 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9txjf\" (UniqueName: \"kubernetes.io/projected/10851644-d2c4-4640-af64-5ea1705e9c20-kube-api-access-9txjf\") pod \"network-check-target-lm6kk\" (UID: \"10851644-d2c4-4640-af64-5ea1705e9c20\") " pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:10:32.829724 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.829709 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 02:10:32.829779 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.829709 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 02:10:32.839034 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.839008 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/068fa366-3ec1-4827-8a33-9a020304ed14-metrics-certs\") pod \"network-metrics-daemon-b94xm\" (UID: \"068fa366-3ec1-4827-8a33-9a020304ed14\") " pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:10:32.839034 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:32.839019 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6506f074-f794-43ca-9b7f-59c5ad3ef8b9-original-pull-secret\") pod \"global-pull-secret-syncer-dlvc8\" (UID: \"6506f074-f794-43ca-9b7f-59c5ad3ef8b9\") " pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:10:33.071161 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.071134 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2zscq\"" Jul 21 02:10:33.079009 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.078956 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b94xm" Jul 21 02:10:33.081776 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.081763 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gcvct\"" Jul 21 02:10:33.083898 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.083884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dlvc8" Jul 21 02:10:33.089353 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.089337 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:10:33.249624 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.249589 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b94xm"] Jul 21 02:10:33.253020 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:33.252989 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068fa366_3ec1_4827_8a33_9a020304ed14.slice/crio-1837e27fc4b4711ccf7ea43cc37478b441ac45d7bb001492f12037e96606d515 WatchSource:0}: Error finding container 1837e27fc4b4711ccf7ea43cc37478b441ac45d7bb001492f12037e96606d515: Status 404 returned error can't find the container with id 1837e27fc4b4711ccf7ea43cc37478b441ac45d7bb001492f12037e96606d515 Jul 21 02:10:33.275999 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.275973 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dlvc8"] Jul 21 02:10:33.278656 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:33.278611 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6506f074_f794_43ca_9b7f_59c5ad3ef8b9.slice/crio-c2b35362664ed9b2e34236f8cb3d1af507a27b5350b05f0d3b33758bab719ddd WatchSource:0}: Error finding container c2b35362664ed9b2e34236f8cb3d1af507a27b5350b05f0d3b33758bab719ddd: Status 404 returned error can't find the container with id c2b35362664ed9b2e34236f8cb3d1af507a27b5350b05f0d3b33758bab719ddd Jul 21 02:10:33.295383 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.295287 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lm6kk"] Jul 21 02:10:33.297735 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:33.297710 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10851644_d2c4_4640_af64_5ea1705e9c20.slice/crio-6a4aafba923c416685367f627d03367fd6e045e5a1241a975626e42336379e4e WatchSource:0}: Error finding container 6a4aafba923c416685367f627d03367fd6e045e5a1241a975626e42336379e4e: Status 404 returned error can't find the container with id 6a4aafba923c416685367f627d03367fd6e045e5a1241a975626e42336379e4e Jul 21 02:10:33.678596 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.678472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b94xm" event={"ID":"068fa366-3ec1-4827-8a33-9a020304ed14","Type":"ContainerStarted","Data":"1837e27fc4b4711ccf7ea43cc37478b441ac45d7bb001492f12037e96606d515"} Jul 21 02:10:33.680557 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.680450 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lm6kk" event={"ID":"10851644-d2c4-4640-af64-5ea1705e9c20","Type":"ContainerStarted","Data":"3f4ea2dbe63332bacc97da849afba7130f3a626de289197e125041b6de04a60c"} Jul 21 02:10:33.680557 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.680499 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lm6kk" event={"ID":"10851644-d2c4-4640-af64-5ea1705e9c20","Type":"ContainerStarted","Data":"6a4aafba923c416685367f627d03367fd6e045e5a1241a975626e42336379e4e"} Jul 21 02:10:33.680557 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.680557 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:10:33.681767 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.681740 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlvc8" event={"ID":"6506f074-f794-43ca-9b7f-59c5ad3ef8b9","Type":"ContainerStarted","Data":"c2b35362664ed9b2e34236f8cb3d1af507a27b5350b05f0d3b33758bab719ddd"} Jul 21 02:10:33.710809 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.710524 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lm6kk" podStartSLOduration=65.710502342 podStartE2EDuration="1m5.710502342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:33.709636839 +0000 UTC m=+66.632315973" watchObservedRunningTime="2026-07-21 02:10:33.710502342 +0000 UTC m=+66.633181450" Jul 21 02:10:33.742343 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.739343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:33.840964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.839887 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:33.840964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.839945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:33.840964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.839974 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:33.840964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.840004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:33.840964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.840044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:33.840964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.840079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:33.840964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.840113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:33.842224 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.841755 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c35362b-794d-4372-9acf-228dfbae4c87-service-ca-bundle\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:33.848319 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.848294 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/fe890ada-031a-4051-b343-05fa32dadc64-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-csxl9\" (UID: \"fe890ada-031a-4051-b343-05fa32dadc64\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:33.848860 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.848756 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e5f97723-7100-417b-bf2e-a686913b1f61-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-xf9hz\" (UID: \"e5f97723-7100-417b-bf2e-a686913b1f61\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:33.848860 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.848817 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/353548bf-2b65-42c8-8a63-b3aed85eea7d-metrics-tls\") pod \"dns-default-nf96x\" (UID: \"353548bf-2b65-42c8-8a63-b3aed85eea7d\") " pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:33.849023 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.848876 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1592f05-5da8-4d01-8a7f-989855bef45a-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-x45vz\" (UID: \"e1592f05-5da8-4d01-8a7f-989855bef45a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:33.849544 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.849506 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c35362b-794d-4372-9acf-228dfbae4c87-metrics-certs\") pod \"router-default-85d48988cd-47vhx\" (UID: \"9c35362b-794d-4372-9acf-228dfbae4c87\") " pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:33.850359 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.850318 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"image-registry-6fb4748b6c-nrr7x\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:33.884789 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.884721 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:33.984349 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:33.984267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:34.003105 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.003077 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6qdf5\"" Jul 21 02:10:34.010639 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.010609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:34.033138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.032946 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wjbzt\"" Jul 21 02:10:34.041279 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.040762 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" Jul 21 02:10:34.058905 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.058883 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wk5lt\"" Jul 21 02:10:34.065825 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.065612 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:34.076826 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.076620 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-f4zk5\"" Jul 21 02:10:34.083553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.083528 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lx8r6\"" Jul 21 02:10:34.083852 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.083763 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" Jul 21 02:10:34.091803 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.091717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:34.092410 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.092163 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z5gpf\"" Jul 21 02:10:34.100004 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.099951 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" Jul 21 02:10:34.221078 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.219613 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fb4748b6c-nrr7x"] Jul 21 02:10:34.246242 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:34.240974 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a561f6d_9ca6_4629_bf09_21cbe984406b.slice/crio-564adb6652b3daae57be5f40578961317240e5b7355cfa646b820bd9cc1bc3a3 WatchSource:0}: Error finding container 564adb6652b3daae57be5f40578961317240e5b7355cfa646b820bd9cc1bc3a3: Status 404 returned error can't find the container with id 564adb6652b3daae57be5f40578961317240e5b7355cfa646b820bd9cc1bc3a3 Jul 21 02:10:34.249179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.249018 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz"] Jul 21 02:10:34.348930 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.348881 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d48988cd-47vhx"] Jul 21 02:10:34.365762 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.365682 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9"] Jul 21 02:10:34.390068 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.390048 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz"] Jul 21 02:10:34.419051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.418959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nf96x"] Jul 21 02:10:34.661469 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:34.661432 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c35362b_794d_4372_9acf_228dfbae4c87.slice/crio-e86f76a7d1b20c1dbd611249bface0f97c843e5d933eaf4518b8178fec701fd4 WatchSource:0}: Error finding container e86f76a7d1b20c1dbd611249bface0f97c843e5d933eaf4518b8178fec701fd4: Status 404 returned error can't find the container with id e86f76a7d1b20c1dbd611249bface0f97c843e5d933eaf4518b8178fec701fd4 Jul 21 02:10:34.662880 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:34.662805 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod353548bf_2b65_42c8_8a63_b3aed85eea7d.slice/crio-104310da2032aa0504a81bbfabf649ce33fdc8262e8a55fffea437b734b28c33 WatchSource:0}: Error finding container 104310da2032aa0504a81bbfabf649ce33fdc8262e8a55fffea437b734b28c33: Status 404 returned error can't find the container with id 104310da2032aa0504a81bbfabf649ce33fdc8262e8a55fffea437b734b28c33 Jul 21 02:10:34.663205 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:34.663186 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f97723_7100_417b_bf2e_a686913b1f61.slice/crio-51240dace146bd24a48d88a4f6a98d3709e07e5ef7a6813d8253fc074105a850 WatchSource:0}: Error finding container 51240dace146bd24a48d88a4f6a98d3709e07e5ef7a6813d8253fc074105a850: Status 404 returned error can't find the container with id 51240dace146bd24a48d88a4f6a98d3709e07e5ef7a6813d8253fc074105a850 Jul 21 02:10:34.664074 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:34.664044 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe890ada_031a_4051_b343_05fa32dadc64.slice/crio-9e39c6469918fdbf0fc790aca29b328bb9f21fb97b149da69101f0a450231bc1 WatchSource:0}: Error finding container 9e39c6469918fdbf0fc790aca29b328bb9f21fb97b149da69101f0a450231bc1: Status 404 returned error can't find the container with id 9e39c6469918fdbf0fc790aca29b328bb9f21fb97b149da69101f0a450231bc1 Jul 21 02:10:34.686910 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.686875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nf96x" event={"ID":"353548bf-2b65-42c8-8a63-b3aed85eea7d","Type":"ContainerStarted","Data":"104310da2032aa0504a81bbfabf649ce33fdc8262e8a55fffea437b734b28c33"} Jul 21 02:10:34.688324 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.688251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d48988cd-47vhx" event={"ID":"9c35362b-794d-4372-9acf-228dfbae4c87","Type":"ContainerStarted","Data":"e86f76a7d1b20c1dbd611249bface0f97c843e5d933eaf4518b8178fec701fd4"} Jul 21 02:10:34.689529 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.689493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" event={"ID":"e1592f05-5da8-4d01-8a7f-989855bef45a","Type":"ContainerStarted","Data":"75cd4268d4df310d615a922997e0d23e6feba14b5242970f29b9e0f8b6db040f"} Jul 21 02:10:34.690799 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.690768 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" event={"ID":"5a561f6d-9ca6-4629-bf09-21cbe984406b","Type":"ContainerStarted","Data":"564adb6652b3daae57be5f40578961317240e5b7355cfa646b820bd9cc1bc3a3"} Jul 21 02:10:34.691977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.691952 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" event={"ID":"e5f97723-7100-417b-bf2e-a686913b1f61","Type":"ContainerStarted","Data":"51240dace146bd24a48d88a4f6a98d3709e07e5ef7a6813d8253fc074105a850"} Jul 21 02:10:34.693397 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:34.693337 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" event={"ID":"fe890ada-031a-4051-b343-05fa32dadc64","Type":"ContainerStarted","Data":"9e39c6469918fdbf0fc790aca29b328bb9f21fb97b149da69101f0a450231bc1"} Jul 21 02:10:37.293955 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:37.293913 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:37.393142 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:37.393108 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:39.714495 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:39.714450 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" event={"ID":"5a561f6d-9ca6-4629-bf09-21cbe984406b","Type":"ContainerStarted","Data":"9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4"} Jul 21 02:10:39.714988 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:39.714580 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:10:39.737953 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:39.737885 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" podStartSLOduration=71.737862929 podStartE2EDuration="1m11.737862929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:39.735513808 +0000 UTC m=+72.658192909" watchObservedRunningTime="2026-07-21 02:10:39.737862929 +0000 UTC m=+72.660542036" Jul 21 02:10:40.158556 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.158465 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:40.269431 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.261455 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:40.558637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.558564 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:40.660118 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.660021 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:40.721218 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.721179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nf96x" event={"ID":"353548bf-2b65-42c8-8a63-b3aed85eea7d","Type":"ContainerStarted","Data":"e07d639b6dcdf6602456eefacb9d1321f3aa52f0ebb2bbf3caeb081d3d65ccd1"} Jul 21 02:10:40.721693 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.721288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nf96x" event={"ID":"353548bf-2b65-42c8-8a63-b3aed85eea7d","Type":"ContainerStarted","Data":"9d4da5b5230b741298d617cf08ff3c48cf039d0348cef1f966f56433c7caa2d9"} Jul 21 02:10:40.721693 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.721318 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:40.723029 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.723002 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj95b" event={"ID":"6481f074-d4d5-477e-8862-78d9812258e0","Type":"ContainerStarted","Data":"9cccbd8efe15866b04e3ba3e9cd79086dd5bd31f71e0c39719e75bd36c19788e"} Jul 21 02:10:40.724782 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.724749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b94xm" event={"ID":"068fa366-3ec1-4827-8a33-9a020304ed14","Type":"ContainerStarted","Data":"624f9269a8dfa82b31ad032c9c14b82870a929570446d3ffbd018e0ef7dba0cc"} Jul 21 02:10:40.724922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.724802 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b94xm" event={"ID":"068fa366-3ec1-4827-8a33-9a020304ed14","Type":"ContainerStarted","Data":"c28da6baab3ffb0400538de0569dad0909296158f858b8e266bc0a62142796f8"} Jul 21 02:10:40.726160 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.726135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d48988cd-47vhx" event={"ID":"9c35362b-794d-4372-9acf-228dfbae4c87","Type":"ContainerStarted","Data":"419ff5894bbbf06c7e43ef20497cacfeee0bff6eb11a136bd639fabf6d9e7199"} Jul 21 02:10:40.727988 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.727961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" event={"ID":"e1592f05-5da8-4d01-8a7f-989855bef45a","Type":"ContainerStarted","Data":"e801b8e4a19defa2e1541955d1972837c291fa59b609e2d8f46713597e7cbc2f"} Jul 21 02:10:40.728099 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.728001 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" event={"ID":"e1592f05-5da8-4d01-8a7f-989855bef45a","Type":"ContainerStarted","Data":"f5253e0ac9235827b1521bd0438ac34f8e22ed7b77ee3c41bc3bb1598b4a4518"} Jul 21 02:10:40.729503 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.729482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dlvc8" event={"ID":"6506f074-f794-43ca-9b7f-59c5ad3ef8b9","Type":"ContainerStarted","Data":"9e9da657552bce3152241d4d3c537d17e36ea98a8ea34143ce157724f37216af"} Jul 21 02:10:40.730832 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.730811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" event={"ID":"e5f97723-7100-417b-bf2e-a686913b1f61","Type":"ContainerStarted","Data":"e4f96ca4b45f2088fdba1222292aaaebad3c75d715f3e14c4517fb462eb27041"} Jul 21 02:10:40.732313 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.732250 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" event={"ID":"fe890ada-031a-4051-b343-05fa32dadc64","Type":"ContainerStarted","Data":"9e2cf5a2a0faa082a86b03715de17b62137dc1505f7836b27fab35649346d1da"} Jul 21 02:10:40.732433 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.732347 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:40.741888 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.741841 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nf96x" podStartSLOduration=34.321918167 podStartE2EDuration="39.741827271s" totalImagesPullingTime="5.419909104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:40.741042069 +0000 UTC m=+73.663721175" watchObservedRunningTime="2026-07-21 02:10:40.741827271 +0000 UTC m=+73.664506356" Jul 21 02:10:40.759896 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.759841 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b94xm" podStartSLOduration=67.167538077 podStartE2EDuration="1m12.759814747s" totalImagesPullingTime="5.59227667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:40.759459003 +0000 UTC m=+73.682138143" watchObservedRunningTime="2026-07-21 02:10:40.759814747 +0000 UTC m=+73.682493853" Jul 21 02:10:40.777581 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.777529 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-csxl9" podStartSLOduration=65.357230537 podStartE2EDuration="1m10.777511219s" totalImagesPullingTime="5.420280682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:40.776837952 +0000 UTC m=+73.699517059" watchObservedRunningTime="2026-07-21 02:10:40.777511219 +0000 UTC m=+73.700190325" Jul 21 02:10:40.796242 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.796181 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dlvc8" podStartSLOduration=66.004049939 podStartE2EDuration="1m12.796160793s" totalImagesPullingTime="6.792110854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:40.794674059 +0000 UTC m=+73.717353184" watchObservedRunningTime="2026-07-21 02:10:40.796160793 +0000 UTC m=+73.718839883" Jul 21 02:10:40.817578 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.817525 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-xf9hz" podStartSLOduration=64.359653988 podStartE2EDuration="1m9.817508085s" totalImagesPullingTime="5.457854097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:40.816947884 +0000 UTC m=+73.739627009" watchObservedRunningTime="2026-07-21 02:10:40.817508085 +0000 UTC m=+73.740187192" Jul 21 02:10:40.838796 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.838735 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-x45vz" podStartSLOduration=65.110221484 podStartE2EDuration="1m10.838714779s" totalImagesPullingTime="5.728493295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:40.837704416 +0000 UTC m=+73.760383524" watchObservedRunningTime="2026-07-21 02:10:40.838714779 +0000 UTC m=+73.761393878" Jul 21 02:10:40.861342 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.861282 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85d48988cd-47vhx" podStartSLOduration=70.861233339 podStartE2EDuration="1m10.861233339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:40.860080031 +0000 UTC m=+73.782759171" watchObservedRunningTime="2026-07-21 02:10:40.861233339 +0000 UTC m=+73.783912448" Jul 21 02:10:40.869514 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.869477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:40.928486 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:40.928402 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:41.029159 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:41.029121 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:41.066251 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:41.066213 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:41.069159 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:41.069136 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:41.228476 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:41.228395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:41.331446 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:41.331411 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:41.737136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:41.737109 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:41.738433 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:41.738413 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85d48988cd-47vhx" Jul 21 02:10:42.233630 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:42.233596 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:42.626514 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:42.626486 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:42.690337 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:42.690300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:43.634361 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:43.634328 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:43.698878 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:43.698844 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:44.040008 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:44.039974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:44.121178 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:44.121145 2565 scope.go:117] "RemoveContainer" containerID="60ba1f70878e5c78939f8cb93725082d894590f40ceeaec7114bd7e8d41bfd83" Jul 21 02:10:44.121376 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:10:44.121355 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-xpmg4_openshift-console-operator(bd6b434b-ab4b-44ee-b840-32249baf5b53)\"" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" podUID="bd6b434b-ab4b-44ee-b840-32249baf5b53" Jul 21 02:10:44.135608 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:44.135580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:45.739098 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:45.739066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:45.752948 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:45.752917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj95b" event={"ID":"6481f074-d4d5-477e-8862-78d9812258e0","Type":"ContainerStarted","Data":"5f3077e1901b339bdb8bc14fb205bbe5de041a710ba10df881ce16b790c3c5fe"} Jul 21 02:10:45.776917 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:45.776868 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gj95b" podStartSLOduration=17.990886099 podStartE2EDuration="34.776853048s" totalImagesPullingTime="16.785966949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:10:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:45.775748558 +0000 UTC m=+78.698427686" watchObservedRunningTime="2026-07-21 02:10:45.776853048 +0000 UTC m=+78.699532176" Jul 21 02:10:45.806084 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:45.806047 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:46.013211 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:46.013179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:46.326139 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:46.326050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:46.389616 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:46.389574 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:47.541363 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:47.541313 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:49.878418 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:49.878305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.173538 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.173442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.284503 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.284470 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.306889 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.306858 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5kwzf"] Jul 21 02:10:50.309994 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.309977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.313716 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.313686 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 02:10:50.313716 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.313712 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 02:10:50.313878 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.313737 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 02:10:50.314931 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.314914 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 02:10:50.315041 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.314911 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bhkmf\"" Jul 21 02:10:50.386982 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.386947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nts4f\" (UniqueName: \"kubernetes.io/projected/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-kube-api-access-nts4f\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.386991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-wtmp\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-textfile\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-root\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-tls\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-metrics-client-ca\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387503 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-sys\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.387503 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.387376 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.479353 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.479279 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.488122 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-wtmp\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488251 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-textfile\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488251 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488251 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488251 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-root\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488282 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-wtmp\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-tls\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-metrics-client-ca\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-sys\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488376 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-root\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nts4f\" (UniqueName: \"kubernetes.io/projected/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-kube-api-access-nts4f\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488419 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-sys\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488471 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-textfile\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488820 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488798 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-accelerators-collector-config\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.488876 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.488845 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-metrics-client-ca\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.490592 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.490572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-tls\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.490592 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.490588 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.496502 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.496471 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nts4f\" (UniqueName: \"kubernetes.io/projected/b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7-kube-api-access-nts4f\") pod \"node-exporter-5kwzf\" (UID: \"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7\") " pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.578809 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.578779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.620229 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.620201 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5kwzf" Jul 21 02:10:50.630544 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:50.630521 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f8e11a_901f_46ae_aaba_bd0a7e38c6b7.slice/crio-bc0324448eebb88eff183027f2836472f4f47f0ad7e35dc518145e4df6a32a53 WatchSource:0}: Error finding container bc0324448eebb88eff183027f2836472f4f47f0ad7e35dc518145e4df6a32a53: Status 404 returned error can't find the container with id bc0324448eebb88eff183027f2836472f4f47f0ad7e35dc518145e4df6a32a53 Jul 21 02:10:50.679655 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.679626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.738215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.738155 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nf96x" Jul 21 02:10:50.775209 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.775173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwzf" event={"ID":"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7","Type":"ContainerStarted","Data":"bc0324448eebb88eff183027f2836472f4f47f0ad7e35dc518145e4df6a32a53"} Jul 21 02:10:50.782671 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.782644 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:50.987775 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:50.987744 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:51.179552 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:51.179518 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:51.273467 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:51.273431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:51.781121 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:51.781084 2565 generic.go:356] "Generic (PLEG): container finished" podID="b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7" containerID="da9338f461556eb1e6952864502a97474e067c70c048d311892f84c775a97f48" exitCode=0 Jul 21 02:10:51.781307 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:51.781169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwzf" event={"ID":"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7","Type":"ContainerDied","Data":"da9338f461556eb1e6952864502a97474e067c70c048d311892f84c775a97f48"} Jul 21 02:10:51.790615 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:51.790589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:52.263863 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.263822 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8644ff996c-552h8"] Jul 21 02:10:52.266294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.266279 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.269342 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.269323 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 02:10:52.269666 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.269649 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tzhm5\"" Jul 21 02:10:52.269776 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.269690 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 02:10:52.269843 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.269806 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 02:10:52.269899 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.269849 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 02:10:52.269899 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.269886 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dvr3pp0v92d1e\"" Jul 21 02:10:52.270099 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.270082 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 02:10:52.291918 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.291890 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8644ff996c-552h8"] Jul 21 02:10:52.300785 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300763 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-grpc-tls\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.300872 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mt9p\" (UniqueName: \"kubernetes.io/projected/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-kube-api-access-6mt9p\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.300872 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.300872 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.300968 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-tls\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.300968 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-metrics-client-ca\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.300968 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300919 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.301054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.300976 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401354 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401320 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-metrics-client-ca\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401354 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401389 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-grpc-tls\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mt9p\" (UniqueName: \"kubernetes.io/projected/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-kube-api-access-6mt9p\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401447 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.401576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.401505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-tls\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.402527 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.402493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-metrics-client-ca\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.404168 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.404135 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.404284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.404216 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-tls\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.404471 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.404453 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-grpc-tls\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.404508 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.404463 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.404508 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.404475 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.404579 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.404507 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.413915 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.413894 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mt9p\" (UniqueName: \"kubernetes.io/projected/58d29a7f-73f7-4a56-9b06-7bdd9d808f9d-kube-api-access-6mt9p\") pod \"thanos-querier-8644ff996c-552h8\" (UID: \"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d\") " pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.575356 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.575286 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:52.721582 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.721548 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8644ff996c-552h8"] Jul 21 02:10:52.725078 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:52.725048 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d29a7f_73f7_4a56_9b06_7bdd9d808f9d.slice/crio-f0a3a12f0ff12a9d6672760e621d6591ddc4f083c63058f3487b71ad69b69449 WatchSource:0}: Error finding container f0a3a12f0ff12a9d6672760e621d6591ddc4f083c63058f3487b71ad69b69449: Status 404 returned error can't find the container with id f0a3a12f0ff12a9d6672760e621d6591ddc4f083c63058f3487b71ad69b69449 Jul 21 02:10:52.770470 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.770435 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:52.786598 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.786563 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwzf" event={"ID":"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7","Type":"ContainerStarted","Data":"1c9d038e15c59edd22862b8a8738af3e1682a64c494d3a924e706c9600fb3f78"} Jul 21 02:10:52.786764 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.786625 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5kwzf" event={"ID":"b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7","Type":"ContainerStarted","Data":"0d2363203f2790181db9ebef32f36edad966f8743d0a18827ae6c3011e95ed41"} Jul 21 02:10:52.787826 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.787806 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" event={"ID":"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d","Type":"ContainerStarted","Data":"f0a3a12f0ff12a9d6672760e621d6591ddc4f083c63058f3487b71ad69b69449"} Jul 21 02:10:52.815759 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.815708 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5kwzf" podStartSLOduration=1.8916041080000001 podStartE2EDuration="2.815691367s" totalImagesPullingTime="859.478656ms" totalInitContainerRuntime="64.608603ms" isStatefulPod=true podCreationTimestamp="2026-07-21 02:10:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:52.814464898 +0000 UTC m=+85.737144024" watchObservedRunningTime="2026-07-21 02:10:52.815691367 +0000 UTC m=+85.738370520" Jul 21 02:10:52.876898 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:52.876811 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:53.235540 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:53.235444 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:53.337677 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:53.337633 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:53.469597 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:53.469554 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:53.729685 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:53.729634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:54.797609 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:54.797574 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" event={"ID":"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d","Type":"ContainerStarted","Data":"788082fb6410af34390461b15879c4c3d03fc2298fe677dc81e9520f53a7614b"} Jul 21 02:10:54.797950 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:54.797641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" event={"ID":"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d","Type":"ContainerStarted","Data":"692e21c3c526df85751e62f3080cda65e2b78c0521f22ca443e7a732dd6c3cdd"} Jul 21 02:10:54.797950 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:54.797671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" event={"ID":"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d","Type":"ContainerStarted","Data":"2250a94280550ce4d8133ad6d9ffb5e02c83a80fb294e3f680c64894060e383d"} Jul 21 02:10:54.900907 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:54.900876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:55.031438 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.031401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:55.120750 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.120665 2565 scope.go:117] "RemoveContainer" containerID="60ba1f70878e5c78939f8cb93725082d894590f40ceeaec7114bd7e8d41bfd83" Jul 21 02:10:55.164396 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.164367 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:55.225678 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.225651 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:55.528346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.528320 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6cc49b7447-th4ps"] Jul 21 02:10:55.531572 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.531552 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.535442 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.535415 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 21 02:10:55.536079 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.536059 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 21 02:10:55.536392 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.536371 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dvsb7\"" Jul 21 02:10:55.536711 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.536695 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 21 02:10:55.544994 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.544974 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 21 02:10:55.546278 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.546238 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 21 02:10:55.554553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.554535 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 21 02:10:55.568911 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.568884 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cc49b7447-th4ps"] Jul 21 02:10:55.627683 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-secret-telemeter-client\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.627841 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-telemeter-client-tls\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.627841 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627719 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.627841 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-federate-client-tls\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.627841 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2hs5\" (UniqueName: \"kubernetes.io/projected/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-kube-api-access-g2hs5\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.627977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-metrics-client-ca\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.627977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-serving-certs-ca-bundle\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.627977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.627917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.728980 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.728894 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-secret-telemeter-client\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.728980 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.728935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-telemeter-client-tls\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.728980 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.728961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.729235 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.728990 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-federate-client-tls\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.729235 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.729016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2hs5\" (UniqueName: \"kubernetes.io/projected/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-kube-api-access-g2hs5\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.729235 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.729045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-metrics-client-ca\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.729414 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.729280 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-serving-certs-ca-bundle\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.729414 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.729319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.730451 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.730379 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-metrics-client-ca\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.730579 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.730519 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-serving-certs-ca-bundle\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.730805 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.730767 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.731706 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.731681 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-secret-telemeter-client\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.731858 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.731838 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-federate-client-tls\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.731934 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.731895 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.732060 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.732042 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-telemeter-client-tls\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.740017 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.739996 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2hs5\" (UniqueName: \"kubernetes.io/projected/1c1240b7-8ad7-455d-a3ab-cbef9b1c8443-kube-api-access-g2hs5\") pod \"telemeter-client-6cc49b7447-th4ps\" (UID: \"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443\") " pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.804907 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.804873 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" event={"ID":"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d","Type":"ContainerStarted","Data":"ee0096129539bdec5e207cf6d2932f13dd13d8fc04df621cd379050457d4d4c4"} Jul 21 02:10:55.805354 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.804944 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" event={"ID":"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d","Type":"ContainerStarted","Data":"f6f6e44169b204c6a2a1ea049692deaebcf5b7c1b34056f71cf9bc11f1f22611"} Jul 21 02:10:55.805354 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.805016 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" event={"ID":"58d29a7f-73f7-4a56-9b06-7bdd9d808f9d","Type":"ContainerStarted","Data":"069ab76570d75c5f6c514894b6e021401b42e57681472c722a29857f49f4b150"} Jul 21 02:10:55.805354 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.805050 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:10:55.806980 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.806952 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:10:55.807094 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.807035 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" event={"ID":"bd6b434b-ab4b-44ee-b840-32249baf5b53","Type":"ContainerStarted","Data":"0f082ab68afed5080087e9e05902dc37119ab6e26adca184465bd1122388f485"} Jul 21 02:10:55.808677 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.808653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:55.832021 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.831974 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" podStartSLOduration=1.358541284 podStartE2EDuration="3.831960054s" totalImagesPullingTime="2.47341877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:10:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:55.830123838 +0000 UTC m=+88.752802975" watchObservedRunningTime="2026-07-21 02:10:55.831960054 +0000 UTC m=+88.754639161" Jul 21 02:10:55.849315 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.849248 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" podStartSLOduration=78.311536067 podStartE2EDuration="1m25.849232825s" totalImagesPullingTime="7.537696758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:55.848362881 +0000 UTC m=+88.771041989" watchObservedRunningTime="2026-07-21 02:10:55.849232825 +0000 UTC m=+88.771911931" Jul 21 02:10:55.852670 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.852628 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" Jul 21 02:10:55.986661 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:55.986641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6cc49b7447-th4ps"] Jul 21 02:10:55.988741 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:10:55.988716 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c1240b7_8ad7_455d_a3ab_cbef9b1c8443.slice/crio-12bbcd416bc45c1d64c15e9dd5feaad0484ec3ec3f489497d0ef5d485f4a512f WatchSource:0}: Error finding container 12bbcd416bc45c1d64c15e9dd5feaad0484ec3ec3f489497d0ef5d485f4a512f: Status 404 returned error can't find the container with id 12bbcd416bc45c1d64c15e9dd5feaad0484ec3ec3f489497d0ef5d485f4a512f Jul 21 02:10:56.166148 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:56.166117 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-xpmg4" Jul 21 02:10:56.365588 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:56.365559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:56.483321 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:56.483277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:56.685384 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:56.685249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:56.804378 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:56.804338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:56.811797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:56.811769 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" event={"ID":"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443","Type":"ContainerStarted","Data":"12bbcd416bc45c1d64c15e9dd5feaad0484ec3ec3f489497d0ef5d485f4a512f"} Jul 21 02:10:56.904386 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:56.904350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:57.027846 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:57.027815 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:57.129131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:57.129104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:57.234605 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:57.234575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:57.335913 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:57.335822 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:58.249877 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:58.249847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:58.426818 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:58.426727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:58.632350 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:58.632315 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:58.822330 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:58.822299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" event={"ID":"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443","Type":"ContainerStarted","Data":"5f964aa5c02631d91c621fd1158ae73802898da573d07cb60c9d6aca2de4f67f"} Jul 21 02:10:58.853284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:58.853233 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:58.915501 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:58.915464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:59.827616 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:59.827579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" event={"ID":"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443","Type":"ContainerStarted","Data":"094987c5d175d9a1aa65505019deb6c07f45c91781d4520af886ba403da6441f"} Jul 21 02:10:59.828118 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:59.827641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" event={"ID":"1c1240b7-8ad7-455d-a3ab-cbef9b1c8443","Type":"ContainerStarted","Data":"c51cdfc391dc1d96f5e15af55b1051242176ef8de969cb59b11163ec52bc104e"} Jul 21 02:10:59.857787 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:59.857735 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6cc49b7447-th4ps" podStartSLOduration=1.716509238 podStartE2EDuration="4.857718796s" totalImagesPullingTime="3.141209558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:10:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:10:59.855400032 +0000 UTC m=+92.778079192" watchObservedRunningTime="2026-07-21 02:10:59.857718796 +0000 UTC m=+92.780397917" Jul 21 02:10:59.896239 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:59.896206 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:10:59.996749 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:10:59.996714 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:00.736408 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:00.736378 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:11:00.938273 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:00.938216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:01.036081 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:01.036052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:01.818011 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:01.817986 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8644ff996c-552h8" Jul 21 02:11:03.098282 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:03.098233 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fb4748b6c-nrr7x"] Jul 21 02:11:03.274722 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:03.274689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:03.367309 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:03.367183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:04.644017 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:04.643978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:04.696391 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:04.696367 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lm6kk" Jul 21 02:11:04.715974 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:04.715945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:06.347095 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.347059 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b985d779b-4vchm"] Jul 21 02:11:06.362407 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.362384 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.362562 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.362487 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b985d779b-4vchm"] Jul 21 02:11:06.365461 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.365437 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 02:11:06.365461 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.365458 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 02:11:06.365652 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.365437 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 02:11:06.365745 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.365732 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 02:11:06.365800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.365791 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 02:11:06.367024 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.367004 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 02:11:06.367126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.367005 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 02:11:06.367126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.367062 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-gvlz8\"" Jul 21 02:11:06.427298 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.427251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-oauth-config\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.427480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.427315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-oauth-serving-cert\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.427480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.427392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-serving-cert\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.427480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.427426 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpr28\" (UniqueName: \"kubernetes.io/projected/c060eb9c-ca62-4272-8a27-b10528a4269f-kube-api-access-gpr28\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.427480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.427448 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-console-config\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.427480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.427463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-service-ca\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.528278 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.528227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-console-config\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.528400 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.528284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-service-ca\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.528400 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.528313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-oauth-config\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.528476 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.528425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-oauth-serving-cert\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.528553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.528538 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-serving-cert\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.528589 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.528576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpr28\" (UniqueName: \"kubernetes.io/projected/c060eb9c-ca62-4272-8a27-b10528a4269f-kube-api-access-gpr28\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.529059 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.529034 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-oauth-serving-cert\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.529059 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.529045 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-console-config\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.529200 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.529048 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-service-ca\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.530794 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.530767 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-oauth-config\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.530794 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.530769 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-serving-cert\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.537148 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.537126 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpr28\" (UniqueName: \"kubernetes.io/projected/c060eb9c-ca62-4272-8a27-b10528a4269f-kube-api-access-gpr28\") pod \"console-6b985d779b-4vchm\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.671966 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.671870 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:06.798160 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.798127 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b985d779b-4vchm"] Jul 21 02:11:06.801111 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:11:06.801081 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc060eb9c_ca62_4272_8a27_b10528a4269f.slice/crio-484eb64bccc69f3042b910c5ba3cbeacb9865b7d19165c2d2d728d762d4c3032 WatchSource:0}: Error finding container 484eb64bccc69f3042b910c5ba3cbeacb9865b7d19165c2d2d728d762d4c3032: Status 404 returned error can't find the container with id 484eb64bccc69f3042b910c5ba3cbeacb9865b7d19165c2d2d728d762d4c3032 Jul 21 02:11:06.851406 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.851368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:06.856919 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.856879 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b985d779b-4vchm" event={"ID":"c060eb9c-ca62-4272-8a27-b10528a4269f","Type":"ContainerStarted","Data":"484eb64bccc69f3042b910c5ba3cbeacb9865b7d19165c2d2d728d762d4c3032"} Jul 21 02:11:06.909540 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:06.909511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:08.890907 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:08.890848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:08.948718 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:08.948683 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:09.869480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:09.869388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b985d779b-4vchm" event={"ID":"c060eb9c-ca62-4272-8a27-b10528a4269f","Type":"ContainerStarted","Data":"16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca"} Jul 21 02:11:09.888907 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:09.888854 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b985d779b-4vchm" podStartSLOduration=1.131952857 podStartE2EDuration="3.888835818s" totalImagesPullingTime="2.756882961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:09.888584823 +0000 UTC m=+102.811263944" watchObservedRunningTime="2026-07-21 02:11:09.888835818 +0000 UTC m=+102.811514924" Jul 21 02:11:10.162125 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:10.162036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:10.262840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:10.262770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:10.445436 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:10.445361 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:10.501892 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:10.501859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:11.146605 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:11.146569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:11.244978 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:11.244950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:14.244136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:14.244098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:14.310620 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:14.310587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:14.847203 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:14.847165 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5468c5585d-9qwv9"] Jul 21 02:11:15.037908 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.037878 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5468c5585d-9qwv9"] Jul 21 02:11:15.038063 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.037977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.047346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.047322 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 21 02:11:15.102011 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.101928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-config\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.102011 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.101980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-oauth-config\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.102217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.102066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-service-ca\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.102217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.102106 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-oauth-serving-cert\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.102217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.102148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-serving-cert\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.102217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.102188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xqhp\" (UniqueName: \"kubernetes.io/projected/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-kube-api-access-9xqhp\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.102380 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.102219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-trusted-ca-bundle\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.203182 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.203144 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xqhp\" (UniqueName: \"kubernetes.io/projected/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-kube-api-access-9xqhp\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.203182 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.203187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-trusted-ca-bundle\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.203462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.203214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-config\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.203462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.203248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-oauth-config\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.203462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.203291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-service-ca\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.203462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.203318 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-oauth-serving-cert\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.203462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.203337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-serving-cert\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.204062 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.204030 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-service-ca\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.204163 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.204081 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-oauth-serving-cert\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.204163 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.204089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-config\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.204420 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.204397 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-trusted-ca-bundle\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.205792 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.205769 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-serving-cert\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.205866 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.205800 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-oauth-config\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.211431 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.211415 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xqhp\" (UniqueName: \"kubernetes.io/projected/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-kube-api-access-9xqhp\") pod \"console-5468c5585d-9qwv9\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.347074 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.347036 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:15.497450 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.497424 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5468c5585d-9qwv9"] Jul 21 02:11:15.499403 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:11:15.499372 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7bfea7f_7df7_44b8_9e0d_52370386f8e7.slice/crio-f6291365174b88f35755f0ec2a5fb39971ed79b74adbe99c96707082f12b80be WatchSource:0}: Error finding container f6291365174b88f35755f0ec2a5fb39971ed79b74adbe99c96707082f12b80be: Status 404 returned error can't find the container with id f6291365174b88f35755f0ec2a5fb39971ed79b74adbe99c96707082f12b80be Jul 21 02:11:15.897638 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.897599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5468c5585d-9qwv9" event={"ID":"b7bfea7f-7df7-44b8-9e0d-52370386f8e7","Type":"ContainerStarted","Data":"2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36"} Jul 21 02:11:15.897968 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.897679 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5468c5585d-9qwv9" event={"ID":"b7bfea7f-7df7-44b8-9e0d-52370386f8e7","Type":"ContainerStarted","Data":"f6291365174b88f35755f0ec2a5fb39971ed79b74adbe99c96707082f12b80be"} Jul 21 02:11:15.917641 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:15.917594 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5468c5585d-9qwv9" podStartSLOduration=1.917580671 podStartE2EDuration="1.917580671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:11:15.915505116 +0000 UTC m=+108.838184244" watchObservedRunningTime="2026-07-21 02:11:15.917580671 +0000 UTC m=+108.840259777" Jul 21 02:11:16.672959 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:16.672919 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:16.673431 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:16.672977 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:16.677882 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:16.677856 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:16.905308 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:16.905283 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:17.657684 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:17.657653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:17.724771 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:17.724740 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:19.056056 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:19.056013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:19.119306 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:19.119246 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:24.062227 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:24.062189 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:24.121881 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:24.121847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:25.153777 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.153742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:25.210516 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.210487 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:25.347351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.347309 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:25.347544 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.347376 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:25.351833 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.351811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:25.937775 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.937741 2565 generic.go:356] "Generic (PLEG): container finished" podID="b6a456e9-68d0-41fe-8000-01b00722f2f8" containerID="b85e5af049027eddccc5f4e1046b71e93c02853916d579b0cff41affd9847f71" exitCode=0 Jul 21 02:11:25.937933 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.937813 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" event={"ID":"b6a456e9-68d0-41fe-8000-01b00722f2f8","Type":"ContainerDied","Data":"b85e5af049027eddccc5f4e1046b71e93c02853916d579b0cff41affd9847f71"} Jul 21 02:11:25.938229 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.938212 2565 scope.go:117] "RemoveContainer" containerID="b85e5af049027eddccc5f4e1046b71e93c02853916d579b0cff41affd9847f71" Jul 21 02:11:25.942038 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:25.942020 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:11:26.007418 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.007389 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b985d779b-4vchm"] Jul 21 02:11:26.182037 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.182012 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:26.278426 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.278391 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:26.578955 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.578920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:26.679997 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.679965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:26.943576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.943490 2565 generic.go:356] "Generic (PLEG): container finished" podID="1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60" containerID="f48a0f4e91e6fdf845f210392b1444c28e9da2423207a08c724ae18480742e71" exitCode=0 Jul 21 02:11:26.943576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.943565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" event={"ID":"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60","Type":"ContainerDied","Data":"f48a0f4e91e6fdf845f210392b1444c28e9da2423207a08c724ae18480742e71"} Jul 21 02:11:26.943979 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.943946 2565 scope.go:117] "RemoveContainer" containerID="f48a0f4e91e6fdf845f210392b1444c28e9da2423207a08c724ae18480742e71" Jul 21 02:11:26.945586 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:26.945558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-hx6nx" event={"ID":"b6a456e9-68d0-41fe-8000-01b00722f2f8","Type":"ContainerStarted","Data":"d83dadeefbffaabb1f8f528be6553e25d803126dfbd8ff0e26978d7db5e5e5ea"} Jul 21 02:11:27.950970 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:27.950937 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-hb4hw" event={"ID":"1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60","Type":"ContainerStarted","Data":"0106c00214d907236f07524a8e57571a1dbaeb8936baa38c8b5a4a7b49638197"} Jul 21 02:11:28.118089 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.118051 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" podUID="5a561f6d-9ca6-4629-bf09-21cbe984406b" containerName="registry" containerID="cri-o://9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4" gracePeriod=30 Jul 21 02:11:28.355771 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.355746 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:11:28.518007 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.517964 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-trusted-ca\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518024 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-installation-pull-secrets\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518091 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-image-registry-private-configuration\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518115 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518151 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmtrm\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-kube-api-access-cmtrm\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518421 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518192 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-certificates\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518421 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518218 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a561f6d-9ca6-4629-bf09-21cbe984406b-ca-trust-extracted\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518421 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518331 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-bound-sa-token\") pod \"5a561f6d-9ca6-4629-bf09-21cbe984406b\" (UID: \"5a561f6d-9ca6-4629-bf09-21cbe984406b\") " Jul 21 02:11:28.518553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518427 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:11:28.518706 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518669 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:11:28.518861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.518746 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-trusted-ca\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.520741 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.520712 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:11:28.520858 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.520811 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:11:28.520916 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.520856 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:11:28.520976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.520905 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-kube-api-access-cmtrm" (OuterVolumeSpecName: "kube-api-access-cmtrm") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "kube-api-access-cmtrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:11:28.520976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.520953 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:11:28.526767 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.526742 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a561f6d-9ca6-4629-bf09-21cbe984406b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5a561f6d-9ca6-4629-bf09-21cbe984406b" (UID: "5a561f6d-9ca6-4629-bf09-21cbe984406b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:11:28.619326 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.619286 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5a561f6d-9ca6-4629-bf09-21cbe984406b-ca-trust-extracted\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.619326 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.619320 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-bound-sa-token\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.619326 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.619333 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-installation-pull-secrets\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.619554 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.619349 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5a561f6d-9ca6-4629-bf09-21cbe984406b-image-registry-private-configuration\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.619554 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.619362 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-tls\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.619554 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.619373 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmtrm\" (UniqueName: \"kubernetes.io/projected/5a561f6d-9ca6-4629-bf09-21cbe984406b-kube-api-access-cmtrm\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.619554 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.619383 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5a561f6d-9ca6-4629-bf09-21cbe984406b-registry-certificates\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:28.956236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.956151 2565 generic.go:356] "Generic (PLEG): container finished" podID="5a561f6d-9ca6-4629-bf09-21cbe984406b" containerID="9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4" exitCode=0 Jul 21 02:11:28.956236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.956191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" event={"ID":"5a561f6d-9ca6-4629-bf09-21cbe984406b","Type":"ContainerDied","Data":"9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4"} Jul 21 02:11:28.956236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.956202 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" Jul 21 02:11:28.956236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.956226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fb4748b6c-nrr7x" event={"ID":"5a561f6d-9ca6-4629-bf09-21cbe984406b","Type":"ContainerDied","Data":"564adb6652b3daae57be5f40578961317240e5b7355cfa646b820bd9cc1bc3a3"} Jul 21 02:11:28.956784 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.956245 2565 scope.go:117] "RemoveContainer" containerID="9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4" Jul 21 02:11:28.965518 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.965503 2565 scope.go:117] "RemoveContainer" containerID="9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4" Jul 21 02:11:28.965753 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:11:28.965736 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4\": container with ID starting with 9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4 not found: ID does not exist" containerID="9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4" Jul 21 02:11:28.965792 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.965762 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4"} err="failed to get container status \"9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4\": rpc error: code = NotFound desc = could not find container \"9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4\": container with ID starting with 9f88d1c1d54916de1fac5dde13bd39dc1a83d11635697388c6271f33f56a22c4 not found: ID does not exist" Jul 21 02:11:28.978033 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.978009 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fb4748b6c-nrr7x"] Jul 21 02:11:28.981485 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:28.981464 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fb4748b6c-nrr7x"] Jul 21 02:11:30.125306 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:30.125270 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a561f6d-9ca6-4629-bf09-21cbe984406b" path="/var/lib/kubelet/pods/5a561f6d-9ca6-4629-bf09-21cbe984406b/volumes" Jul 21 02:11:33.924967 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:33.924934 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:34.025622 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:34.025589 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:34.081514 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:34.081485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:11:36.987641 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:36.987609 2565 generic.go:356] "Generic (PLEG): container finished" podID="1612e1fc-af23-4cb9-8539-184a90640300" containerID="1137e313ae8e0e31d476cfc671ebd12ebf746ecf7269cac720bc206ab8929a07" exitCode=0 Jul 21 02:11:36.988028 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:36.987665 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rc8hc" event={"ID":"1612e1fc-af23-4cb9-8539-184a90640300","Type":"ContainerDied","Data":"1137e313ae8e0e31d476cfc671ebd12ebf746ecf7269cac720bc206ab8929a07"} Jul 21 02:11:36.988028 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:36.987969 2565 scope.go:117] "RemoveContainer" containerID="1137e313ae8e0e31d476cfc671ebd12ebf746ecf7269cac720bc206ab8929a07" Jul 21 02:11:37.993839 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:37.993801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-rc8hc" event={"ID":"1612e1fc-af23-4cb9-8539-184a90640300","Type":"ContainerStarted","Data":"f65dfb4bb1ef05a614ca9a19a3f4f581facff03958a6ab4b2fadd99e589976aa"} Jul 21 02:11:51.038933 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.038852 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b985d779b-4vchm" podUID="c060eb9c-ca62-4272-8a27-b10528a4269f" containerName="console" containerID="cri-o://16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca" gracePeriod=15 Jul 21 02:11:51.311072 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.310688 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:51.412289 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.412236 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-oauth-serving-cert\") pod \"c060eb9c-ca62-4272-8a27-b10528a4269f\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " Jul 21 02:11:51.412560 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.412541 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpr28\" (UniqueName: \"kubernetes.io/projected/c060eb9c-ca62-4272-8a27-b10528a4269f-kube-api-access-gpr28\") pod \"c060eb9c-ca62-4272-8a27-b10528a4269f\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " Jul 21 02:11:51.412691 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.412679 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-oauth-config\") pod \"c060eb9c-ca62-4272-8a27-b10528a4269f\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " Jul 21 02:11:51.412795 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.412587 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c060eb9c-ca62-4272-8a27-b10528a4269f" (UID: "c060eb9c-ca62-4272-8a27-b10528a4269f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:11:51.412901 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.412886 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-service-ca\") pod \"c060eb9c-ca62-4272-8a27-b10528a4269f\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " Jul 21 02:11:51.412995 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.412983 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-console-config\") pod \"c060eb9c-ca62-4272-8a27-b10528a4269f\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " Jul 21 02:11:51.413118 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.413104 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-serving-cert\") pod \"c060eb9c-ca62-4272-8a27-b10528a4269f\" (UID: \"c060eb9c-ca62-4272-8a27-b10528a4269f\") " Jul 21 02:11:51.413294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.413249 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-service-ca" (OuterVolumeSpecName: "service-ca") pod "c060eb9c-ca62-4272-8a27-b10528a4269f" (UID: "c060eb9c-ca62-4272-8a27-b10528a4269f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:11:51.413549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.413531 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-service-ca\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:51.413646 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.413624 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-console-config" (OuterVolumeSpecName: "console-config") pod "c060eb9c-ca62-4272-8a27-b10528a4269f" (UID: "c060eb9c-ca62-4272-8a27-b10528a4269f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:11:51.413731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.413717 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-oauth-serving-cert\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:51.415106 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.415076 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c060eb9c-ca62-4272-8a27-b10528a4269f-kube-api-access-gpr28" (OuterVolumeSpecName: "kube-api-access-gpr28") pod "c060eb9c-ca62-4272-8a27-b10528a4269f" (UID: "c060eb9c-ca62-4272-8a27-b10528a4269f"). InnerVolumeSpecName "kube-api-access-gpr28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:11:51.415891 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.415864 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c060eb9c-ca62-4272-8a27-b10528a4269f" (UID: "c060eb9c-ca62-4272-8a27-b10528a4269f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:11:51.417536 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.417513 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c060eb9c-ca62-4272-8a27-b10528a4269f" (UID: "c060eb9c-ca62-4272-8a27-b10528a4269f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:11:51.514248 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.514217 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-serving-cert\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:51.514426 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.514249 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpr28\" (UniqueName: \"kubernetes.io/projected/c060eb9c-ca62-4272-8a27-b10528a4269f-kube-api-access-gpr28\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:51.514426 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.514294 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c060eb9c-ca62-4272-8a27-b10528a4269f-console-oauth-config\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:51.514426 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:51.514307 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c060eb9c-ca62-4272-8a27-b10528a4269f-console-config\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:11:52.055039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.055004 2565 generic.go:356] "Generic (PLEG): container finished" podID="c060eb9c-ca62-4272-8a27-b10528a4269f" containerID="16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca" exitCode=0 Jul 21 02:11:52.055039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.055044 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b985d779b-4vchm" event={"ID":"c060eb9c-ca62-4272-8a27-b10528a4269f","Type":"ContainerDied","Data":"16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca"} Jul 21 02:11:52.055513 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.055065 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b985d779b-4vchm" Jul 21 02:11:52.055513 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.055108 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b985d779b-4vchm" event={"ID":"c060eb9c-ca62-4272-8a27-b10528a4269f","Type":"ContainerDied","Data":"484eb64bccc69f3042b910c5ba3cbeacb9865b7d19165c2d2d728d762d4c3032"} Jul 21 02:11:52.055513 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.055130 2565 scope.go:117] "RemoveContainer" containerID="16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca" Jul 21 02:11:52.063642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.063627 2565 scope.go:117] "RemoveContainer" containerID="16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca" Jul 21 02:11:52.063922 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:11:52.063901 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca\": container with ID starting with 16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca not found: ID does not exist" containerID="16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca" Jul 21 02:11:52.063986 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.063930 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca"} err="failed to get container status \"16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca\": rpc error: code = NotFound desc = could not find container \"16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca\": container with ID starting with 16a4245fe577dce26c67d1132fc38d60f8736e99d04c13242fffdb39fce165ca not found: ID does not exist" Jul 21 02:11:52.078106 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.078072 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b985d779b-4vchm"] Jul 21 02:11:52.082383 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.082361 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b985d779b-4vchm"] Jul 21 02:11:52.125381 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:11:52.125355 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c060eb9c-ca62-4272-8a27-b10528a4269f" path="/var/lib/kubelet/pods/c060eb9c-ca62-4272-8a27-b10528a4269f/volumes" Jul 21 02:12:03.182479 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:03.182441 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:03.242993 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:03.242961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:06.375370 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:06.375331 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:06.435606 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:06.435565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:12.521552 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.521513 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 02:12:12.521945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.521840 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c060eb9c-ca62-4272-8a27-b10528a4269f" containerName="console" Jul 21 02:12:12.521945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.521851 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c060eb9c-ca62-4272-8a27-b10528a4269f" containerName="console" Jul 21 02:12:12.521945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.521864 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a561f6d-9ca6-4629-bf09-21cbe984406b" containerName="registry" Jul 21 02:12:12.521945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.521870 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a561f6d-9ca6-4629-bf09-21cbe984406b" containerName="registry" Jul 21 02:12:12.521945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.521924 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c060eb9c-ca62-4272-8a27-b10528a4269f" containerName="console" Jul 21 02:12:12.521945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.521934 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a561f6d-9ca6-4629-bf09-21cbe984406b" containerName="registry" Jul 21 02:12:12.526015 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.525995 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.529592 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.529565 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xhfj8\"" Jul 21 02:12:12.529740 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.529588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 21 02:12:12.529911 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.529881 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 21 02:12:12.530159 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.529949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 21 02:12:12.530159 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.529967 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 21 02:12:12.530357 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.529977 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 21 02:12:12.530357 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.530049 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 21 02:12:12.530357 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.530063 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 21 02:12:12.530579 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.530561 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 21 02:12:12.535747 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.535725 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 21 02:12:12.541918 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.541892 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 02:12:12.684848 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.684824 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.684984 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.684857 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hxzn\" (UniqueName: \"kubernetes.io/projected/13da0700-98b6-4671-ad0b-897f281f2f5c-kube-api-access-7hxzn\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.684984 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.684884 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.684984 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.684905 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13da0700-98b6-4671-ad0b-897f281f2f5c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.684984 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.684928 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13da0700-98b6-4671-ad0b-897f281f2f5c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.684984 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.684967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.685215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.684993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/13da0700-98b6-4671-ad0b-897f281f2f5c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.685215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.685012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13da0700-98b6-4671-ad0b-897f281f2f5c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.685215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.685031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-config-volume\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.685215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.685045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.685215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.685128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.685215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.685165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-web-config\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.685215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.685205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13da0700-98b6-4671-ad0b-897f281f2f5c-config-out\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785701 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13da0700-98b6-4671-ad0b-897f281f2f5c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785701 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13da0700-98b6-4671-ad0b-897f281f2f5c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/13da0700-98b6-4671-ad0b-897f281f2f5c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13da0700-98b6-4671-ad0b-897f281f2f5c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785783 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-config-volume\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.785850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786124 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-web-config\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786124 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13da0700-98b6-4671-ad0b-897f281f2f5c-config-out\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786124 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786124 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.785965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hxzn\" (UniqueName: \"kubernetes.io/projected/13da0700-98b6-4671-ad0b-897f281f2f5c-kube-api-access-7hxzn\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786124 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.786019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786407 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.786341 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/13da0700-98b6-4671-ad0b-897f281f2f5c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.786673 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13da0700-98b6-4671-ad0b-897f281f2f5c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.786964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.786938 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13da0700-98b6-4671-ad0b-897f281f2f5c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.788711 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.788684 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/13da0700-98b6-4671-ad0b-897f281f2f5c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.788867 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.788845 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/13da0700-98b6-4671-ad0b-897f281f2f5c-config-out\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.788934 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.788865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.788934 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.788908 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.789078 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.789055 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.789308 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.789289 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-config-volume\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.789560 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.789536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.789617 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.789586 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.790783 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.790762 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/13da0700-98b6-4671-ad0b-897f281f2f5c-web-config\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.798114 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.798093 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hxzn\" (UniqueName: \"kubernetes.io/projected/13da0700-98b6-4671-ad0b-897f281f2f5c-kube-api-access-7hxzn\") pod \"alertmanager-main-0\" (UID: \"13da0700-98b6-4671-ad0b-897f281f2f5c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.836069 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.836051 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 21 02:12:12.967126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:12.966953 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 21 02:12:12.969909 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:12:12.969885 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13da0700_98b6_4671_ad0b_897f281f2f5c.slice/crio-eaf774cb088a9a0902370db42635713b8ec4e39d41887e4c97b8633a00877568 WatchSource:0}: Error finding container eaf774cb088a9a0902370db42635713b8ec4e39d41887e4c97b8633a00877568: Status 404 returned error can't find the container with id eaf774cb088a9a0902370db42635713b8ec4e39d41887e4c97b8633a00877568 Jul 21 02:12:13.144016 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:13.143984 2565 generic.go:356] "Generic (PLEG): container finished" podID="13da0700-98b6-4671-ad0b-897f281f2f5c" containerID="8494bbd5385472be96adaefd4b81af31c69a3bc1a4d21e4fd08cc7d1aeeac8e5" exitCode=0 Jul 21 02:12:13.144136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:13.144038 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerDied","Data":"8494bbd5385472be96adaefd4b81af31c69a3bc1a4d21e4fd08cc7d1aeeac8e5"} Jul 21 02:12:13.144136 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:13.144104 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerStarted","Data":"eaf774cb088a9a0902370db42635713b8ec4e39d41887e4c97b8633a00877568"} Jul 21 02:12:15.156479 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:15.156407 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerStarted","Data":"be44d5c54774efaffb78c0ca73e2d3f26c7fb5ea11530146f294e1c204138d2e"} Jul 21 02:12:15.156781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:15.156490 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerStarted","Data":"eaec50e8e122c02fdc4abc65606247c1730d97e5960e460fa5f35881b926473c"} Jul 21 02:12:15.156781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:15.156535 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerStarted","Data":"a3f1de5b1bb3ca9c37fe28b734a6dbaefbcaeb3549f9becff16a5d8441c95ae2"} Jul 21 02:12:15.156781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:15.156576 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerStarted","Data":"299244e5970897d8fce7467030ff28aafd60e0be0cb56dde1a0acf56f02f8c5a"} Jul 21 02:12:15.156781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:15.156619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerStarted","Data":"3437109eb3ab3d1174173b343b1807483ddf52a475364932eb19b038d53ba209"} Jul 21 02:12:15.156781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:15.156658 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"13da0700-98b6-4671-ad0b-897f281f2f5c","Type":"ContainerStarted","Data":"690ea4443be679e0c8d2eb407ed12884feb88a7fc0c4c091bdbc8a664b272dd6"} Jul 21 02:12:15.188834 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:15.188785 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.738791194 podStartE2EDuration="3.188770673s" totalImagesPullingTime="1.434539371s" totalInitContainerRuntime="15.440108ms" isStatefulPod=false podCreationTimestamp="2026-07-21 02:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:12:15.188246104 +0000 UTC m=+168.110925228" watchObservedRunningTime="2026-07-21 02:12:15.188770673 +0000 UTC m=+168.111449779" Jul 21 02:12:18.346300 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:18.346246 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:18.401096 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:18.401066 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:25.169346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:25.169308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:25.266310 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:25.266282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:31.938801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:31.938762 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d7df7c6dc-c2h2s"] Jul 21 02:12:31.944287 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:31.944264 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:31.952368 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:31.952345 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7df7c6dc-c2h2s"] Jul 21 02:12:31.988349 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:31.988316 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:32.039635 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.039608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-serving-cert\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.039764 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.039638 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-trusted-ca-bundle\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.039764 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.039682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-service-ca\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.039840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.039786 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-oauth-config\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.039840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.039812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-console-config\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.039840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.039831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-oauth-serving-cert\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.039926 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.039847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjdx9\" (UniqueName: \"kubernetes.io/projected/2af8b470-f828-4a9a-8475-60a485a43803-kube-api-access-wjdx9\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.141228 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.141195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-oauth-config\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.141228 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.141226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-console-config\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.141528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.141244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-oauth-serving-cert\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.141528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.141278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjdx9\" (UniqueName: \"kubernetes.io/projected/2af8b470-f828-4a9a-8475-60a485a43803-kube-api-access-wjdx9\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.141528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.141329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-serving-cert\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.141528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.141351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-trusted-ca-bundle\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.141528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.141406 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-service-ca\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.142099 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.142072 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-oauth-serving-cert\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.142189 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.142073 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-console-config\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.142189 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.142137 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-service-ca\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.142319 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.142184 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-trusted-ca-bundle\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.143759 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.143731 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-serving-cert\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.143845 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.143764 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-oauth-config\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.150520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.150499 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjdx9\" (UniqueName: \"kubernetes.io/projected/2af8b470-f828-4a9a-8475-60a485a43803-kube-api-access-wjdx9\") pod \"console-5d7df7c6dc-c2h2s\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.254570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.254538 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:32.386082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:32.386055 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d7df7c6dc-c2h2s"] Jul 21 02:12:32.386175 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:12:32.386099 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af8b470_f828_4a9a_8475_60a485a43803.slice/crio-69e01f519570dd29ed184b49cf81da94188456da077fd3a01917c3a835c845ad WatchSource:0}: Error finding container 69e01f519570dd29ed184b49cf81da94188456da077fd3a01917c3a835c845ad: Status 404 returned error can't find the container with id 69e01f519570dd29ed184b49cf81da94188456da077fd3a01917c3a835c845ad Jul 21 02:12:33.231801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:33.231770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7df7c6dc-c2h2s" event={"ID":"2af8b470-f828-4a9a-8475-60a485a43803","Type":"ContainerStarted","Data":"27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0"} Jul 21 02:12:33.232174 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:33.231819 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7df7c6dc-c2h2s" event={"ID":"2af8b470-f828-4a9a-8475-60a485a43803","Type":"ContainerStarted","Data":"69e01f519570dd29ed184b49cf81da94188456da077fd3a01917c3a835c845ad"} Jul 21 02:12:33.252276 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:33.252219 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d7df7c6dc-c2h2s" podStartSLOduration=2.252179945 podStartE2EDuration="2.252179945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:12:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:12:33.250860463 +0000 UTC m=+186.173539587" watchObservedRunningTime="2026-07-21 02:12:33.252179945 +0000 UTC m=+186.174859052" Jul 21 02:12:35.495765 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:35.495720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:41.759370 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:41.759334 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:42.255181 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.255157 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:42.255372 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.255217 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:42.259573 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.259551 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:42.270707 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.270686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:12:42.324682 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.324653 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5468c5585d-9qwv9"] Jul 21 02:12:42.460872 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.460837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:42.561293 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.561204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:42.661839 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:42.661812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:54.529237 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:54.529199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:54.629465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:54.629434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:12:55.318656 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.318623 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px"] Jul 21 02:12:55.322204 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.322183 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.325403 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.325384 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wlfjr\"" Jul 21 02:12:55.325709 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.325689 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 02:12:55.326886 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.326872 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 02:12:55.330796 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.330776 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px"] Jul 21 02:12:55.443543 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.443505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.443724 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.443568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zksvw\" (UniqueName: \"kubernetes.io/projected/f171d452-1e38-41cc-ac89-d66396e5e2a2-kube-api-access-zksvw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.443724 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.443593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.544440 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.544402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.544865 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.544454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zksvw\" (UniqueName: \"kubernetes.io/projected/f171d452-1e38-41cc-ac89-d66396e5e2a2-kube-api-access-zksvw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.544865 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.544480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.544865 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.544759 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.544865 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.544794 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.554364 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.554334 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zksvw\" (UniqueName: \"kubernetes.io/projected/f171d452-1e38-41cc-ac89-d66396e5e2a2-kube-api-access-zksvw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.632766 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.632678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:12:55.759647 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:55.759622 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px"] Jul 21 02:12:55.761749 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:12:55.761721 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf171d452_1e38_41cc_ac89_d66396e5e2a2.slice/crio-7fe990696ee04b696b9880bc744d4c49e80fce850034619ee2e4d07f8d57b7ea WatchSource:0}: Error finding container 7fe990696ee04b696b9880bc744d4c49e80fce850034619ee2e4d07f8d57b7ea: Status 404 returned error can't find the container with id 7fe990696ee04b696b9880bc744d4c49e80fce850034619ee2e4d07f8d57b7ea Jul 21 02:12:56.328236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:56.328202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" event={"ID":"f171d452-1e38-41cc-ac89-d66396e5e2a2","Type":"ContainerStarted","Data":"7fe990696ee04b696b9880bc744d4c49e80fce850034619ee2e4d07f8d57b7ea"} Jul 21 02:12:57.863563 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:12:57.863525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:07.349393 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.349349 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5468c5585d-9qwv9" podUID="b7bfea7f-7df7-44b8-9e0d-52370386f8e7" containerName="console" containerID="cri-o://2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36" gracePeriod=15 Jul 21 02:13:07.384182 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.384148 2565 generic.go:356] "Generic (PLEG): container finished" podID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerID="4e4521f9768f65c9dc390b84abd15529d0de91736d9add790ea2467d9f83ac34" exitCode=0 Jul 21 02:13:07.384367 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.384179 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" event={"ID":"f171d452-1e38-41cc-ac89-d66396e5e2a2","Type":"ContainerDied","Data":"4e4521f9768f65c9dc390b84abd15529d0de91736d9add790ea2467d9f83ac34"} Jul 21 02:13:07.593196 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.593172 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:13:07.755230 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755196 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-oauth-config\") pod \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " Jul 21 02:13:07.755407 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xqhp\" (UniqueName: \"kubernetes.io/projected/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-kube-api-access-9xqhp\") pod \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " Jul 21 02:13:07.755407 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755303 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-service-ca\") pod \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " Jul 21 02:13:07.755407 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755342 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-trusted-ca-bundle\") pod \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " Jul 21 02:13:07.755553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755477 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-config\") pod \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " Jul 21 02:13:07.755553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755534 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-serving-cert\") pod \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " Jul 21 02:13:07.755663 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755584 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-oauth-serving-cert\") pod \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\" (UID: \"b7bfea7f-7df7-44b8-9e0d-52370386f8e7\") " Jul 21 02:13:07.755851 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755787 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-service-ca" (OuterVolumeSpecName: "service-ca") pod "b7bfea7f-7df7-44b8-9e0d-52370386f8e7" (UID: "b7bfea7f-7df7-44b8-9e0d-52370386f8e7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:13:07.755851 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755806 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b7bfea7f-7df7-44b8-9e0d-52370386f8e7" (UID: "b7bfea7f-7df7-44b8-9e0d-52370386f8e7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:13:07.756017 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.755863 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-config" (OuterVolumeSpecName: "console-config") pod "b7bfea7f-7df7-44b8-9e0d-52370386f8e7" (UID: "b7bfea7f-7df7-44b8-9e0d-52370386f8e7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:13:07.756070 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.756018 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-service-ca\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:07.756070 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.756039 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-trusted-ca-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:07.756070 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.756053 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b7bfea7f-7df7-44b8-9e0d-52370386f8e7" (UID: "b7bfea7f-7df7-44b8-9e0d-52370386f8e7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:13:07.757463 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.757446 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b7bfea7f-7df7-44b8-9e0d-52370386f8e7" (UID: "b7bfea7f-7df7-44b8-9e0d-52370386f8e7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:13:07.757834 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.757817 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b7bfea7f-7df7-44b8-9e0d-52370386f8e7" (UID: "b7bfea7f-7df7-44b8-9e0d-52370386f8e7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:13:07.757882 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.757845 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-kube-api-access-9xqhp" (OuterVolumeSpecName: "kube-api-access-9xqhp") pod "b7bfea7f-7df7-44b8-9e0d-52370386f8e7" (UID: "b7bfea7f-7df7-44b8-9e0d-52370386f8e7"). InnerVolumeSpecName "kube-api-access-9xqhp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:13:07.856748 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.856707 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-config\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:07.856748 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.856740 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-serving-cert\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:07.856748 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.856752 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-oauth-serving-cert\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:07.856973 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.856763 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-console-oauth-config\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:07.856973 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:07.856773 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xqhp\" (UniqueName: \"kubernetes.io/projected/b7bfea7f-7df7-44b8-9e0d-52370386f8e7-kube-api-access-9xqhp\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:08.035215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.035130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:08.390485 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.390391 2565 generic.go:356] "Generic (PLEG): container finished" podID="b7bfea7f-7df7-44b8-9e0d-52370386f8e7" containerID="2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36" exitCode=0 Jul 21 02:13:08.390485 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.390448 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5468c5585d-9qwv9" Jul 21 02:13:08.390932 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.390474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5468c5585d-9qwv9" event={"ID":"b7bfea7f-7df7-44b8-9e0d-52370386f8e7","Type":"ContainerDied","Data":"2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36"} Jul 21 02:13:08.390932 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.390544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5468c5585d-9qwv9" event={"ID":"b7bfea7f-7df7-44b8-9e0d-52370386f8e7","Type":"ContainerDied","Data":"f6291365174b88f35755f0ec2a5fb39971ed79b74adbe99c96707082f12b80be"} Jul 21 02:13:08.390932 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.390575 2565 scope.go:117] "RemoveContainer" containerID="2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36" Jul 21 02:13:08.400759 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.400743 2565 scope.go:117] "RemoveContainer" containerID="2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36" Jul 21 02:13:08.401014 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:13:08.400995 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36\": container with ID starting with 2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36 not found: ID does not exist" containerID="2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36" Jul 21 02:13:08.401079 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.401022 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36"} err="failed to get container status \"2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36\": rpc error: code = NotFound desc = could not find container \"2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36\": container with ID starting with 2eb602cce42a4cb90806efdd7e2654bda04a2fe9495f1e2a5294fb3b17309f36 not found: ID does not exist" Jul 21 02:13:08.409856 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.409832 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5468c5585d-9qwv9"] Jul 21 02:13:08.415662 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:08.415633 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5468c5585d-9qwv9"] Jul 21 02:13:10.125307 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:10.125273 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7bfea7f-7df7-44b8-9e0d-52370386f8e7" path="/var/lib/kubelet/pods/b7bfea7f-7df7-44b8-9e0d-52370386f8e7/volumes" Jul 21 02:13:10.401404 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:10.401309 2565 generic.go:356] "Generic (PLEG): container finished" podID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerID="da758fb1a6721c77f6dba632db92baad407d06758e70c3fe12a210a1f3a537b7" exitCode=0 Jul 21 02:13:10.401404 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:10.401370 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" event={"ID":"f171d452-1e38-41cc-ac89-d66396e5e2a2","Type":"ContainerDied","Data":"da758fb1a6721c77f6dba632db92baad407d06758e70c3fe12a210a1f3a537b7"} Jul 21 02:13:18.441002 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:18.440966 2565 generic.go:356] "Generic (PLEG): container finished" podID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerID="e8fb16f3e25e8e3f8680a09f63f667ac01b4639f9c867f87ea90c1ed7bfa1f1b" exitCode=0 Jul 21 02:13:18.441398 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:18.441042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" event={"ID":"f171d452-1e38-41cc-ac89-d66396e5e2a2","Type":"ContainerDied","Data":"e8fb16f3e25e8e3f8680a09f63f667ac01b4639f9c867f87ea90c1ed7bfa1f1b"} Jul 21 02:13:19.571305 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.571274 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:13:19.665754 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.665717 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-bundle\") pod \"f171d452-1e38-41cc-ac89-d66396e5e2a2\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " Jul 21 02:13:19.665902 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.665778 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zksvw\" (UniqueName: \"kubernetes.io/projected/f171d452-1e38-41cc-ac89-d66396e5e2a2-kube-api-access-zksvw\") pod \"f171d452-1e38-41cc-ac89-d66396e5e2a2\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " Jul 21 02:13:19.665902 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.665797 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-util\") pod \"f171d452-1e38-41cc-ac89-d66396e5e2a2\" (UID: \"f171d452-1e38-41cc-ac89-d66396e5e2a2\") " Jul 21 02:13:19.666412 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.666376 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-bundle" (OuterVolumeSpecName: "bundle") pod "f171d452-1e38-41cc-ac89-d66396e5e2a2" (UID: "f171d452-1e38-41cc-ac89-d66396e5e2a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:13:19.667927 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.667903 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f171d452-1e38-41cc-ac89-d66396e5e2a2-kube-api-access-zksvw" (OuterVolumeSpecName: "kube-api-access-zksvw") pod "f171d452-1e38-41cc-ac89-d66396e5e2a2" (UID: "f171d452-1e38-41cc-ac89-d66396e5e2a2"). InnerVolumeSpecName "kube-api-access-zksvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:13:19.669731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.669706 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-util" (OuterVolumeSpecName: "util") pod "f171d452-1e38-41cc-ac89-d66396e5e2a2" (UID: "f171d452-1e38-41cc-ac89-d66396e5e2a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:13:19.766548 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.766517 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:19.766548 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.766547 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zksvw\" (UniqueName: \"kubernetes.io/projected/f171d452-1e38-41cc-ac89-d66396e5e2a2-kube-api-access-zksvw\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:19.766744 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:19.766560 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f171d452-1e38-41cc-ac89-d66396e5e2a2-util\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:20.451961 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:20.451889 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" Jul 21 02:13:20.452100 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:20.451888 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zh6px" event={"ID":"f171d452-1e38-41cc-ac89-d66396e5e2a2","Type":"ContainerDied","Data":"7fe990696ee04b696b9880bc744d4c49e80fce850034619ee2e4d07f8d57b7ea"} Jul 21 02:13:20.452100 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:20.452004 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7fe990696ee04b696b9880bc744d4c49e80fce850034619ee2e4d07f8d57b7ea" Jul 21 02:13:26.437586 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:26.437549 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:27.513132 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:27.513093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:28.430532 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430494 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc"] Jul 21 02:13:28.430820 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430808 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerName="util" Jul 21 02:13:28.430861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430822 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerName="util" Jul 21 02:13:28.430861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430835 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerName="extract" Jul 21 02:13:28.430861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430840 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerName="extract" Jul 21 02:13:28.430861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430855 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7bfea7f-7df7-44b8-9e0d-52370386f8e7" containerName="console" Jul 21 02:13:28.430861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430861 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7bfea7f-7df7-44b8-9e0d-52370386f8e7" containerName="console" Jul 21 02:13:28.431004 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430867 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerName="pull" Jul 21 02:13:28.431004 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430873 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerName="pull" Jul 21 02:13:28.431004 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430927 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f171d452-1e38-41cc-ac89-d66396e5e2a2" containerName="extract" Jul 21 02:13:28.431004 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.430934 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7bfea7f-7df7-44b8-9e0d-52370386f8e7" containerName="console" Jul 21 02:13:28.434466 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.434448 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.437385 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.437363 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 21 02:13:28.437508 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.437419 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:13:28.437573 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.437503 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-zbm8s\"" Jul 21 02:13:28.449983 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.449959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc"] Jul 21 02:13:28.542451 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.542417 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c54e3b0-1f95-48cd-921e-49d3501757d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ph2kc\" (UID: \"6c54e3b0-1f95-48cd-921e-49d3501757d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.542856 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.542467 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4x9d\" (UniqueName: \"kubernetes.io/projected/6c54e3b0-1f95-48cd-921e-49d3501757d4-kube-api-access-s4x9d\") pod \"cert-manager-operator-controller-manager-55c444bf86-ph2kc\" (UID: \"6c54e3b0-1f95-48cd-921e-49d3501757d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.642941 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.642903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c54e3b0-1f95-48cd-921e-49d3501757d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ph2kc\" (UID: \"6c54e3b0-1f95-48cd-921e-49d3501757d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.643138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.642959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4x9d\" (UniqueName: \"kubernetes.io/projected/6c54e3b0-1f95-48cd-921e-49d3501757d4-kube-api-access-s4x9d\") pod \"cert-manager-operator-controller-manager-55c444bf86-ph2kc\" (UID: \"6c54e3b0-1f95-48cd-921e-49d3501757d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.643360 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.643336 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c54e3b0-1f95-48cd-921e-49d3501757d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ph2kc\" (UID: \"6c54e3b0-1f95-48cd-921e-49d3501757d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.652600 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.652579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4x9d\" (UniqueName: \"kubernetes.io/projected/6c54e3b0-1f95-48cd-921e-49d3501757d4-kube-api-access-s4x9d\") pod \"cert-manager-operator-controller-manager-55c444bf86-ph2kc\" (UID: \"6c54e3b0-1f95-48cd-921e-49d3501757d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.743645 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.743539 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" Jul 21 02:13:28.879140 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:28.879109 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc"] Jul 21 02:13:28.880542 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:13:28.880507 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c54e3b0_1f95_48cd_921e_49d3501757d4.slice/crio-640ee849e18d8469b5abffe694f2653daf34786e30ea1a4d54235f5e90df3960 WatchSource:0}: Error finding container 640ee849e18d8469b5abffe694f2653daf34786e30ea1a4d54235f5e90df3960: Status 404 returned error can't find the container with id 640ee849e18d8469b5abffe694f2653daf34786e30ea1a4d54235f5e90df3960 Jul 21 02:13:29.490653 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:29.490624 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" event={"ID":"6c54e3b0-1f95-48cd-921e-49d3501757d4","Type":"ContainerStarted","Data":"640ee849e18d8469b5abffe694f2653daf34786e30ea1a4d54235f5e90df3960"} Jul 21 02:13:30.044861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:30.044821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:30.161607 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:30.161558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:30.497417 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:30.497369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" event={"ID":"6c54e3b0-1f95-48cd-921e-49d3501757d4","Type":"ContainerStarted","Data":"52e1daf9a63a4ceb6842b3bbd1e8b7025b2483faf474d43e0a353332a4906765"} Jul 21 02:13:30.522700 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:30.522609 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ph2kc" podStartSLOduration=1.000137726 podStartE2EDuration="2.522584242s" totalImagesPullingTime="1.522446516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:13:30.520729951 +0000 UTC m=+243.443409059" watchObservedRunningTime="2026-07-21 02:13:30.522584242 +0000 UTC m=+243.445263351" Jul 21 02:13:31.029333 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.029298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:31.155849 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.155814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:31.889516 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.889479 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv"] Jul 21 02:13:31.892183 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.892167 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:31.895612 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.895584 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 02:13:31.895612 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.895589 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 02:13:31.895795 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.895670 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wlfjr\"" Jul 21 02:13:31.901965 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.901943 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv"] Jul 21 02:13:31.976087 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.976054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:31.976276 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.976112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:31.976276 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:31.976138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmjw4\" (UniqueName: \"kubernetes.io/projected/4497bfdb-7518-4b76-b2fa-ce9120d802b5-kube-api-access-cmjw4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.077122 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.077076 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmjw4\" (UniqueName: \"kubernetes.io/projected/4497bfdb-7518-4b76-b2fa-ce9120d802b5-kube-api-access-cmjw4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.077323 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.077191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.077323 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.077282 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.077616 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.077595 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.077684 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.077633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.094305 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.094252 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmjw4\" (UniqueName: \"kubernetes.io/projected/4497bfdb-7518-4b76-b2fa-ce9120d802b5-kube-api-access-cmjw4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.201944 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.201860 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:32.265738 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.265693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:32.336065 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.336043 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv"] Jul 21 02:13:32.337948 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:13:32.337915 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4497bfdb_7518_4b76_b2fa_ce9120d802b5.slice/crio-821bacf3a031abff37a5bd3d0fe6db309dbed7bd2ac5f7bde6ea4a24ec4be3a4 WatchSource:0}: Error finding container 821bacf3a031abff37a5bd3d0fe6db309dbed7bd2ac5f7bde6ea4a24ec4be3a4: Status 404 returned error can't find the container with id 821bacf3a031abff37a5bd3d0fe6db309dbed7bd2ac5f7bde6ea4a24ec4be3a4 Jul 21 02:13:32.340065 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.340039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:32.507910 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.507879 2565 generic.go:356] "Generic (PLEG): container finished" podID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerID="d07a322ec9d03969602c43e21f1ea7e1c40eb3f825e077d805fb79e9d1189747" exitCode=0 Jul 21 02:13:32.508082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.507970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" event={"ID":"4497bfdb-7518-4b76-b2fa-ce9120d802b5","Type":"ContainerDied","Data":"d07a322ec9d03969602c43e21f1ea7e1c40eb3f825e077d805fb79e9d1189747"} Jul 21 02:13:32.508082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:32.508026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" event={"ID":"4497bfdb-7518-4b76-b2fa-ce9120d802b5","Type":"ContainerStarted","Data":"821bacf3a031abff37a5bd3d0fe6db309dbed7bd2ac5f7bde6ea4a24ec4be3a4"} Jul 21 02:13:34.284913 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:34.284877 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:34.690702 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:34.690675 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:35.523888 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:35.523857 2565 generic.go:356] "Generic (PLEG): container finished" podID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerID="4480d32188e67a01f2f6c21de6272466e4d55acab33e282b0502d77a58452caf" exitCode=0 Jul 21 02:13:35.524321 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:35.523954 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" event={"ID":"4497bfdb-7518-4b76-b2fa-ce9120d802b5","Type":"ContainerDied","Data":"4480d32188e67a01f2f6c21de6272466e4d55acab33e282b0502d77a58452caf"} Jul 21 02:13:36.530533 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:36.530489 2565 generic.go:356] "Generic (PLEG): container finished" podID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerID="30e8edfca1483bd9e5f0a0e9bee11df3c2cf3d2f0910afd2174a2dba03c4cd99" exitCode=0 Jul 21 02:13:36.530938 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:36.530579 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" event={"ID":"4497bfdb-7518-4b76-b2fa-ce9120d802b5","Type":"ContainerDied","Data":"30e8edfca1483bd9e5f0a0e9bee11df3c2cf3d2f0910afd2174a2dba03c4cd99"} Jul 21 02:13:36.641768 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:36.641726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:36.742135 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:36.742102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:37.662099 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.662072 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:37.725343 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.725311 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-util\") pod \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " Jul 21 02:13:37.725519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.725401 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-bundle\") pod \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " Jul 21 02:13:37.725519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.725451 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmjw4\" (UniqueName: \"kubernetes.io/projected/4497bfdb-7518-4b76-b2fa-ce9120d802b5-kube-api-access-cmjw4\") pod \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\" (UID: \"4497bfdb-7518-4b76-b2fa-ce9120d802b5\") " Jul 21 02:13:37.725838 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.725813 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-bundle" (OuterVolumeSpecName: "bundle") pod "4497bfdb-7518-4b76-b2fa-ce9120d802b5" (UID: "4497bfdb-7518-4b76-b2fa-ce9120d802b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:13:37.727562 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.727530 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4497bfdb-7518-4b76-b2fa-ce9120d802b5-kube-api-access-cmjw4" (OuterVolumeSpecName: "kube-api-access-cmjw4") pod "4497bfdb-7518-4b76-b2fa-ce9120d802b5" (UID: "4497bfdb-7518-4b76-b2fa-ce9120d802b5"). InnerVolumeSpecName "kube-api-access-cmjw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:13:37.732313 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.732282 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-util" (OuterVolumeSpecName: "util") pod "4497bfdb-7518-4b76-b2fa-ce9120d802b5" (UID: "4497bfdb-7518-4b76-b2fa-ce9120d802b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:13:37.826191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.826107 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:37.826191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.826138 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmjw4\" (UniqueName: \"kubernetes.io/projected/4497bfdb-7518-4b76-b2fa-ce9120d802b5-kube-api-access-cmjw4\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:37.826191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:37.826150 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4497bfdb-7518-4b76-b2fa-ce9120d802b5-util\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:38.541014 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:38.540986 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" Jul 21 02:13:38.541014 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:38.540992 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgnzrv" event={"ID":"4497bfdb-7518-4b76-b2fa-ce9120d802b5","Type":"ContainerDied","Data":"821bacf3a031abff37a5bd3d0fe6db309dbed7bd2ac5f7bde6ea4a24ec4be3a4"} Jul 21 02:13:38.541215 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:38.541037 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="821bacf3a031abff37a5bd3d0fe6db309dbed7bd2ac5f7bde6ea4a24ec4be3a4" Jul 21 02:13:39.390277 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.390228 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn"] Jul 21 02:13:39.391294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.391060 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerName="extract" Jul 21 02:13:39.391294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.391084 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerName="extract" Jul 21 02:13:39.391294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.391112 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerName="util" Jul 21 02:13:39.391294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.391122 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerName="util" Jul 21 02:13:39.391294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.391131 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerName="pull" Jul 21 02:13:39.391294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.391139 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerName="pull" Jul 21 02:13:39.391633 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.391310 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4497bfdb-7518-4b76-b2fa-ce9120d802b5" containerName="extract" Jul 21 02:13:39.396381 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.396362 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.401008 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.400987 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 02:13:39.401008 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.400996 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ptljf\"" Jul 21 02:13:39.401219 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.400996 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 02:13:39.401411 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.401394 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn"] Jul 21 02:13:39.440360 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.440332 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7790a0d0-32a2-4fc2-907d-0b53c67d69e9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2jbsn\" (UID: \"7790a0d0-32a2-4fc2-907d-0b53c67d69e9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.440528 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.440375 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5c99\" (UniqueName: \"kubernetes.io/projected/7790a0d0-32a2-4fc2-907d-0b53c67d69e9-kube-api-access-h5c99\") pod \"cert-manager-cainjector-559cdd8c87-2jbsn\" (UID: \"7790a0d0-32a2-4fc2-907d-0b53c67d69e9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.541134 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.541092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7790a0d0-32a2-4fc2-907d-0b53c67d69e9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2jbsn\" (UID: \"7790a0d0-32a2-4fc2-907d-0b53c67d69e9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.541134 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.541135 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5c99\" (UniqueName: \"kubernetes.io/projected/7790a0d0-32a2-4fc2-907d-0b53c67d69e9-kube-api-access-h5c99\") pod \"cert-manager-cainjector-559cdd8c87-2jbsn\" (UID: \"7790a0d0-32a2-4fc2-907d-0b53c67d69e9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.550293 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.550271 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7790a0d0-32a2-4fc2-907d-0b53c67d69e9-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2jbsn\" (UID: \"7790a0d0-32a2-4fc2-907d-0b53c67d69e9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.550428 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.550306 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5c99\" (UniqueName: \"kubernetes.io/projected/7790a0d0-32a2-4fc2-907d-0b53c67d69e9-kube-api-access-h5c99\") pod \"cert-manager-cainjector-559cdd8c87-2jbsn\" (UID: \"7790a0d0-32a2-4fc2-907d-0b53c67d69e9\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.719905 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.719826 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" Jul 21 02:13:39.851586 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:39.851563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn"] Jul 21 02:13:39.853230 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:13:39.853206 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7790a0d0_32a2_4fc2_907d_0b53c67d69e9.slice/crio-2890d74f53ea06ee3f81af2a98b605af7e47820c790e88b04b1baa42def5aac6 WatchSource:0}: Error finding container 2890d74f53ea06ee3f81af2a98b605af7e47820c790e88b04b1baa42def5aac6: Status 404 returned error can't find the container with id 2890d74f53ea06ee3f81af2a98b605af7e47820c790e88b04b1baa42def5aac6 Jul 21 02:13:40.058977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:40.058945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:40.159801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:40.159771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:40.551041 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:40.551009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" event={"ID":"7790a0d0-32a2-4fc2-907d-0b53c67d69e9","Type":"ContainerStarted","Data":"2890d74f53ea06ee3f81af2a98b605af7e47820c790e88b04b1baa42def5aac6"} Jul 21 02:13:42.083086 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.082996 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264"] Jul 21 02:13:42.086893 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.086868 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.090069 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.090037 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 02:13:42.090219 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.090119 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mphsl\"" Jul 21 02:13:42.091964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.091910 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 02:13:42.095000 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.094978 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264"] Jul 21 02:13:42.165045 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.165002 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18193e2e-7dbd-487f-93ba-b33537f751c0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xb264\" (UID: \"18193e2e-7dbd-487f-93ba-b33537f751c0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.165233 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.165103 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5f7t\" (UniqueName: \"kubernetes.io/projected/18193e2e-7dbd-487f-93ba-b33537f751c0-kube-api-access-b5f7t\") pod \"openshift-lws-operator-fd8ccff4c-xb264\" (UID: \"18193e2e-7dbd-487f-93ba-b33537f751c0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.266035 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.266002 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5f7t\" (UniqueName: \"kubernetes.io/projected/18193e2e-7dbd-487f-93ba-b33537f751c0-kube-api-access-b5f7t\") pod \"openshift-lws-operator-fd8ccff4c-xb264\" (UID: \"18193e2e-7dbd-487f-93ba-b33537f751c0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.266200 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.266123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18193e2e-7dbd-487f-93ba-b33537f751c0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xb264\" (UID: \"18193e2e-7dbd-487f-93ba-b33537f751c0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.266509 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.266491 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18193e2e-7dbd-487f-93ba-b33537f751c0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xb264\" (UID: \"18193e2e-7dbd-487f-93ba-b33537f751c0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.275431 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.275404 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5f7t\" (UniqueName: \"kubernetes.io/projected/18193e2e-7dbd-487f-93ba-b33537f751c0-kube-api-access-b5f7t\") pod \"openshift-lws-operator-fd8ccff4c-xb264\" (UID: \"18193e2e-7dbd-487f-93ba-b33537f751c0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.400201 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.400114 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" Jul 21 02:13:42.923085 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.923057 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:42.935137 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:42.935086 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264"] Jul 21 02:13:42.936985 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:13:42.936956 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18193e2e_7dbd_487f_93ba_b33537f751c0.slice/crio-b730326b84df0608b809496ce8dc3a700c24764dd85da516c0c8365bdeb1c62b WatchSource:0}: Error finding container b730326b84df0608b809496ce8dc3a700c24764dd85da516c0c8365bdeb1c62b: Status 404 returned error can't find the container with id b730326b84df0608b809496ce8dc3a700c24764dd85da516c0c8365bdeb1c62b Jul 21 02:13:43.570575 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:43.570525 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" event={"ID":"18193e2e-7dbd-487f-93ba-b33537f751c0","Type":"ContainerStarted","Data":"b730326b84df0608b809496ce8dc3a700c24764dd85da516c0c8365bdeb1c62b"} Jul 21 02:13:43.572378 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:43.572340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" event={"ID":"7790a0d0-32a2-4fc2-907d-0b53c67d69e9","Type":"ContainerStarted","Data":"f2ff01bc9606724f698a3f4101c1bcc2081c2e769bf19d4db7aad062bd90c61b"} Jul 21 02:13:43.595405 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:43.595348 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2jbsn" podStartSLOduration=1.583186156 podStartE2EDuration="4.595328764s" totalImagesPullingTime="3.012142608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:13:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:13:43.593085968 +0000 UTC m=+256.515765094" watchObservedRunningTime="2026-07-21 02:13:43.595328764 +0000 UTC m=+256.518007871" Jul 21 02:13:43.669922 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:43.669890 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:43.742639 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:43.742603 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:45.583433 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:45.583398 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" event={"ID":"18193e2e-7dbd-487f-93ba-b33537f751c0","Type":"ContainerStarted","Data":"cfe9e8337a97d6422ee6a6bb468e54d85b657ecd77bdfc590ba371b772919ada"} Jul 21 02:13:45.604472 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:45.604421 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xb264" podStartSLOduration=1.961772388 podStartE2EDuration="3.604399383s" totalImagesPullingTime="1.642626995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:13:45.602667672 +0000 UTC m=+258.525346776" watchObservedRunningTime="2026-07-21 02:13:45.604399383 +0000 UTC m=+258.527078491" Jul 21 02:13:46.233607 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:46.233573 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:46.331801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:46.331770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:48.131579 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.131549 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk"] Jul 21 02:13:48.139803 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.139782 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.144734 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.144705 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 02:13:48.144900 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.144715 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wlfjr\"" Jul 21 02:13:48.145147 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.145122 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 02:13:48.145647 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.145626 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk"] Jul 21 02:13:48.223085 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.223050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9ccz\" (UniqueName: \"kubernetes.io/projected/cf8693cd-1f25-4666-aadb-25c80c275f9c-kube-api-access-h9ccz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.223287 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.223179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.223287 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.223218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.324573 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.324536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.324758 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.324584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.324758 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.324623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9ccz\" (UniqueName: \"kubernetes.io/projected/cf8693cd-1f25-4666-aadb-25c80c275f9c-kube-api-access-h9ccz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.325007 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.324986 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.325098 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.325077 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.333523 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.333494 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9ccz\" (UniqueName: \"kubernetes.io/projected/cf8693cd-1f25-4666-aadb-25c80c275f9c-kube-api-access-h9ccz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.344040 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.344013 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:13:48.453616 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.453526 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:48.580418 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.580397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk"] Jul 21 02:13:48.581972 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:13:48.581947 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8693cd_1f25_4666_aadb_25c80c275f9c.slice/crio-90915ec04759ac476d57d66ed796e6bafc954a9fc45a4427e1264fca414fcda7 WatchSource:0}: Error finding container 90915ec04759ac476d57d66ed796e6bafc954a9fc45a4427e1264fca414fcda7: Status 404 returned error can't find the container with id 90915ec04759ac476d57d66ed796e6bafc954a9fc45a4427e1264fca414fcda7 Jul 21 02:13:48.600632 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:48.600585 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" event={"ID":"cf8693cd-1f25-4666-aadb-25c80c275f9c","Type":"ContainerStarted","Data":"90915ec04759ac476d57d66ed796e6bafc954a9fc45a4427e1264fca414fcda7"} Jul 21 02:13:48.698674 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:13:48.698645 2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8693cd_1f25_4666_aadb_25c80c275f9c.slice/crio-91280c4d6a78aa2cf9205cf5953da52e412eebe65469bf72001502535a93ac55.scope\": RecentStats: unable to find data in memory cache]" Jul 21 02:13:49.606356 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:49.606247 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerID="91280c4d6a78aa2cf9205cf5953da52e412eebe65469bf72001502535a93ac55" exitCode=0 Jul 21 02:13:49.606734 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:49.606352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" event={"ID":"cf8693cd-1f25-4666-aadb-25c80c275f9c","Type":"ContainerDied","Data":"91280c4d6a78aa2cf9205cf5953da52e412eebe65469bf72001502535a93ac55"} Jul 21 02:13:50.612490 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:50.612459 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerID="459357474cd97d565606c69711315d7bdd47bfb1953d0eca03cbfd0b8d99f75c" exitCode=0 Jul 21 02:13:50.612884 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:50.612549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" event={"ID":"cf8693cd-1f25-4666-aadb-25c80c275f9c","Type":"ContainerDied","Data":"459357474cd97d565606c69711315d7bdd47bfb1953d0eca03cbfd0b8d99f75c"} Jul 21 02:13:51.619309 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:51.619275 2565 generic.go:356] "Generic (PLEG): container finished" podID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerID="de8372695d333128e84b9a6fbd1ee45bbd07cec45a3c8e0b0340806d9593de8f" exitCode=0 Jul 21 02:13:51.619655 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:51.619352 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" event={"ID":"cf8693cd-1f25-4666-aadb-25c80c275f9c","Type":"ContainerDied","Data":"de8372695d333128e84b9a6fbd1ee45bbd07cec45a3c8e0b0340806d9593de8f"} Jul 21 02:13:52.750875 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.750851 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:52.864567 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.864535 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-util\") pod \"cf8693cd-1f25-4666-aadb-25c80c275f9c\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " Jul 21 02:13:52.864740 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.864588 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9ccz\" (UniqueName: \"kubernetes.io/projected/cf8693cd-1f25-4666-aadb-25c80c275f9c-kube-api-access-h9ccz\") pod \"cf8693cd-1f25-4666-aadb-25c80c275f9c\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " Jul 21 02:13:52.864740 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.864630 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-bundle\") pod \"cf8693cd-1f25-4666-aadb-25c80c275f9c\" (UID: \"cf8693cd-1f25-4666-aadb-25c80c275f9c\") " Jul 21 02:13:52.865411 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.865380 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-bundle" (OuterVolumeSpecName: "bundle") pod "cf8693cd-1f25-4666-aadb-25c80c275f9c" (UID: "cf8693cd-1f25-4666-aadb-25c80c275f9c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:13:52.866749 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.866719 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8693cd-1f25-4666-aadb-25c80c275f9c-kube-api-access-h9ccz" (OuterVolumeSpecName: "kube-api-access-h9ccz") pod "cf8693cd-1f25-4666-aadb-25c80c275f9c" (UID: "cf8693cd-1f25-4666-aadb-25c80c275f9c"). InnerVolumeSpecName "kube-api-access-h9ccz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:13:52.869717 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.869698 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-util" (OuterVolumeSpecName: "util") pod "cf8693cd-1f25-4666-aadb-25c80c275f9c" (UID: "cf8693cd-1f25-4666-aadb-25c80c275f9c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:13:52.965669 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.965587 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-util\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:52.965669 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.965616 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9ccz\" (UniqueName: \"kubernetes.io/projected/cf8693cd-1f25-4666-aadb-25c80c275f9c-kube-api-access-h9ccz\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:52.965669 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:52.965627 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cf8693cd-1f25-4666-aadb-25c80c275f9c-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:13:53.630279 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:53.630222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" event={"ID":"cf8693cd-1f25-4666-aadb-25c80c275f9c","Type":"ContainerDied","Data":"90915ec04759ac476d57d66ed796e6bafc954a9fc45a4427e1264fca414fcda7"} Jul 21 02:13:53.630450 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:53.630291 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af6d8gk" Jul 21 02:13:53.630450 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:13:53.630299 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90915ec04759ac476d57d66ed796e6bafc954a9fc45a4427e1264fca414fcda7" Jul 21 02:14:05.078809 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:05.078773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:05.195873 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:05.195842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:05.669554 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:05.669522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:05.939381 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:05.939346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:06.047007 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.046973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:06.071018 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.070985 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6"] Jul 21 02:14:06.071376 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.071363 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerName="util" Jul 21 02:14:06.071376 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.071377 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerName="util" Jul 21 02:14:06.071506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.071388 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerName="pull" Jul 21 02:14:06.071506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.071393 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerName="pull" Jul 21 02:14:06.071506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.071402 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerName="extract" Jul 21 02:14:06.071506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.071410 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerName="extract" Jul 21 02:14:06.071506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.071500 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8693cd-1f25-4666-aadb-25c80c275f9c" containerName="extract" Jul 21 02:14:06.074341 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.074326 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.079696 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.079671 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 02:14:06.083591 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.083570 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 02:14:06.083720 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.083702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 02:14:06.088032 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.088017 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 02:14:06.106142 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.106115 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t8cff\"" Jul 21 02:14:06.108032 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.108007 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6"] Jul 21 02:14:06.180728 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.180698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8adeea6c-f7f0-4ad0-8c60-66e764017f56-manifests\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.180728 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.180733 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8adeea6c-f7f0-4ad0-8c60-66e764017f56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.180948 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.180770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8adeea6c-f7f0-4ad0-8c60-66e764017f56-tmp\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.180948 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.180836 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8adeea6c-f7f0-4ad0-8c60-66e764017f56-webhook-cert\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.180948 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.180877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nd8n\" (UniqueName: \"kubernetes.io/projected/8adeea6c-f7f0-4ad0-8c60-66e764017f56-kube-api-access-6nd8n\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.281919 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.281872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8adeea6c-f7f0-4ad0-8c60-66e764017f56-manifests\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.281919 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.281920 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8adeea6c-f7f0-4ad0-8c60-66e764017f56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.282173 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.281946 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8adeea6c-f7f0-4ad0-8c60-66e764017f56-tmp\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.282173 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.281971 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8adeea6c-f7f0-4ad0-8c60-66e764017f56-webhook-cert\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.282173 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.281995 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nd8n\" (UniqueName: \"kubernetes.io/projected/8adeea6c-f7f0-4ad0-8c60-66e764017f56-kube-api-access-6nd8n\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.282380 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.282287 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8adeea6c-f7f0-4ad0-8c60-66e764017f56-manifests\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.284027 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.284001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:06.284475 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.284442 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8adeea6c-f7f0-4ad0-8c60-66e764017f56-tmp\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.284573 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.284540 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8adeea6c-f7f0-4ad0-8c60-66e764017f56-webhook-cert\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.284573 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.284549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8adeea6c-f7f0-4ad0-8c60-66e764017f56-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.294777 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.294754 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nd8n\" (UniqueName: \"kubernetes.io/projected/8adeea6c-f7f0-4ad0-8c60-66e764017f56-kube-api-access-6nd8n\") pod \"opendatahub-operator-controller-manager-8475997445-6zxd6\" (UID: \"8adeea6c-f7f0-4ad0-8c60-66e764017f56\") " pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.383841 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.383816 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:06.384051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.384027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:06.489222 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.489135 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:06.523982 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.523960 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6"] Jul 21 02:14:06.525522 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:14:06.525496 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8adeea6c_f7f0_4ad0_8c60_66e764017f56.slice/crio-1b9364e3e21d1e5275dc2beab570ce8945d03706bc98a180c37cb78139dc4d49 WatchSource:0}: Error finding container 1b9364e3e21d1e5275dc2beab570ce8945d03706bc98a180c37cb78139dc4d49: Status 404 returned error can't find the container with id 1b9364e3e21d1e5275dc2beab570ce8945d03706bc98a180c37cb78139dc4d49 Jul 21 02:14:06.656644 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.656559 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:06.691447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.691409 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" event={"ID":"8adeea6c-f7f0-4ad0-8c60-66e764017f56","Type":"ContainerStarted","Data":"1b9364e3e21d1e5275dc2beab570ce8945d03706bc98a180c37cb78139dc4d49"} Jul 21 02:14:06.758048 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:06.758007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:09.709291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:09.709241 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" event={"ID":"8adeea6c-f7f0-4ad0-8c60-66e764017f56","Type":"ContainerStarted","Data":"0c28dd47e97e07518c7714fe2782437156cc6fc5e4cc22c38d6cad82665ede80"} Jul 21 02:14:10.715863 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:10.715830 2565 generic.go:356] "Generic (PLEG): container finished" podID="8adeea6c-f7f0-4ad0-8c60-66e764017f56" containerID="0c28dd47e97e07518c7714fe2782437156cc6fc5e4cc22c38d6cad82665ede80" exitCode=0 Jul 21 02:14:10.716191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:10.715875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" event={"ID":"8adeea6c-f7f0-4ad0-8c60-66e764017f56","Type":"ContainerDied","Data":"0c28dd47e97e07518c7714fe2782437156cc6fc5e4cc22c38d6cad82665ede80"} Jul 21 02:14:11.723929 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:11.723892 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" event={"ID":"8adeea6c-f7f0-4ad0-8c60-66e764017f56","Type":"ContainerStarted","Data":"dbd233cf9cbae021d1a64a436e9babfc5b81aaad02b933dceb0575bf2c9d9290"} Jul 21 02:14:11.724389 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:11.723971 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:11.750198 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:11.750145 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" podStartSLOduration=1.352156456 podStartE2EDuration="5.750130391s" totalImagesPullingTime="3.343114551s" totalInitContainerRuntime="1.054859384s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:14:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:14:11.747977986 +0000 UTC m=+284.670657112" watchObservedRunningTime="2026-07-21 02:14:11.750130391 +0000 UTC m=+284.672809549" Jul 21 02:14:15.353542 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:15.353507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:15.460337 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:15.460305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:17.662363 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:17.662329 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:17.759620 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:17.759594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:21.822241 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:21.822181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:22.036241 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:22.036211 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:22.731047 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:22.731019 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8475997445-6zxd6" Jul 21 02:14:23.656187 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.656146 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt"] Jul 21 02:14:23.659975 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.659952 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.664619 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.664596 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 02:14:23.664714 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.664619 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 02:14:23.664714 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.664632 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-q6xtf\"" Jul 21 02:14:23.664714 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.664619 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 02:14:23.669341 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.669315 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt"] Jul 21 02:14:23.723905 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.723878 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69027aa9-cd43-4adb-9475-3847a80325d4-manager-config\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.724017 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.723932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdhsj\" (UniqueName: \"kubernetes.io/projected/69027aa9-cd43-4adb-9475-3847a80325d4-kube-api-access-tdhsj\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.724017 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.723964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69027aa9-cd43-4adb-9475-3847a80325d4-cert\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.724017 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.724003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69027aa9-cd43-4adb-9475-3847a80325d4-metrics-cert\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.825073 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.825046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69027aa9-cd43-4adb-9475-3847a80325d4-cert\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.825189 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.825088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69027aa9-cd43-4adb-9475-3847a80325d4-metrics-cert\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.825189 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.825121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69027aa9-cd43-4adb-9475-3847a80325d4-manager-config\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.825189 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.825156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdhsj\" (UniqueName: \"kubernetes.io/projected/69027aa9-cd43-4adb-9475-3847a80325d4-kube-api-access-tdhsj\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.825900 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.825876 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/69027aa9-cd43-4adb-9475-3847a80325d4-manager-config\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.827487 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.827466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/69027aa9-cd43-4adb-9475-3847a80325d4-metrics-cert\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.827578 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.827561 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/69027aa9-cd43-4adb-9475-3847a80325d4-cert\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.834722 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.834699 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdhsj\" (UniqueName: \"kubernetes.io/projected/69027aa9-cd43-4adb-9475-3847a80325d4-kube-api-access-tdhsj\") pod \"lws-controller-manager-76876d4bcd-t5wlt\" (UID: \"69027aa9-cd43-4adb-9475-3847a80325d4\") " pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:23.970121 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:23.970048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:24.098974 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:24.098951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt"] Jul 21 02:14:24.100489 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:14:24.100457 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69027aa9_cd43_4adb_9475_3847a80325d4.slice/crio-e21fa229c4723f3819ef5282eed3eea17c588ade4cd3f483ae71fd0f2494bec0 WatchSource:0}: Error finding container e21fa229c4723f3819ef5282eed3eea17c588ade4cd3f483ae71fd0f2494bec0: Status 404 returned error can't find the container with id e21fa229c4723f3819ef5282eed3eea17c588ade4cd3f483ae71fd0f2494bec0 Jul 21 02:14:24.787217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:24.787182 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" event={"ID":"69027aa9-cd43-4adb-9475-3847a80325d4","Type":"ContainerStarted","Data":"e21fa229c4723f3819ef5282eed3eea17c588ade4cd3f483ae71fd0f2494bec0"} Jul 21 02:14:25.793600 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:25.793566 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" event={"ID":"69027aa9-cd43-4adb-9475-3847a80325d4","Type":"ContainerStarted","Data":"6a9d7fa817b1aeaf6aac8317fc3502353413ab380bb43f9b5bc072c6a0d4a66a"} Jul 21 02:14:25.793975 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:25.793620 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:25.826365 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:25.825372 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" podStartSLOduration=1.436685768 podStartE2EDuration="2.825352706s" totalImagesPullingTime="1.388666938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:14:25.824656552 +0000 UTC m=+298.747335692" watchObservedRunningTime="2026-07-21 02:14:25.825352706 +0000 UTC m=+298.748031812" Jul 21 02:14:26.616012 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:26.615977 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:26.737911 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:26.737881 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:27.454938 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:27.454907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:27.554037 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:27.554004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:27.650791 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:27.650759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:27.750734 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:27.750662 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:27.988455 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:27.988426 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:14:27.993321 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:27.993298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:14:28.003474 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:28.003418 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 02:14:28.159638 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:28.159512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:28.520009 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:28.519979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:36.801098 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:36.801068 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76876d4bcd-t5wlt" Jul 21 02:14:37.405597 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:37.405570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:39.433159 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:39.433102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:40.449040 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:40.448982 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:40.539384 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:40.539325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:41.080471 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:41.080442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:41.191149 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:41.191123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:41.290759 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:41.290712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:42.187593 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:42.187565 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:46.207772 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.207676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:46.307454 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.307405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:46.759910 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.759877 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq"] Jul 21 02:14:46.766610 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.766589 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.769662 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.769640 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2vbjf\"" Jul 21 02:14:46.770181 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.770163 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 21 02:14:46.777421 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.777399 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq"] Jul 21 02:14:46.795717 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.795685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:46.892408 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.892375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:46.930625 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930799 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930629 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-data\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930799 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b64de6f-9e9b-4ecc-80ec-546b74692635-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930799 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930799 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930961 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930961 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqmnk\" (UniqueName: \"kubernetes.io/projected/1b64de6f-9e9b-4ecc-80ec-546b74692635-kube-api-access-cqmnk\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930961 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930853 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:46.930961 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:46.930883 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-token\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.031898 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.031819 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.031898 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.031863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-data\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032114 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.031970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b64de6f-9e9b-4ecc-80ec-546b74692635-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032114 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032029 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032114 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032071 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032163 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqmnk\" (UniqueName: \"kubernetes.io/projected/1b64de6f-9e9b-4ecc-80ec-546b74692635-kube-api-access-cqmnk\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-token\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032541 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032294 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-data\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032611 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032581 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032709 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032686 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b64de6f-9e9b-4ecc-80ec-546b74692635-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.032814 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.032784 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.034397 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.034374 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.034786 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.034766 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.043050 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.043028 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b64de6f-9e9b-4ecc-80ec-546b74692635-istio-token\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.043123 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.043107 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqmnk\" (UniqueName: \"kubernetes.io/projected/1b64de6f-9e9b-4ecc-80ec-546b74692635-kube-api-access-cqmnk\") pod \"data-science-gateway-data-science-gateway-class-554689689dv7mfq\" (UID: \"1b64de6f-9e9b-4ecc-80ec-546b74692635\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.078010 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.077990 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:47.131874 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.131849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:14:47.220812 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.220787 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq"] Jul 21 02:14:47.222283 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:14:47.222248 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b64de6f_9e9b_4ecc_80ec_546b74692635.slice/crio-84a93d608bf9460e820f36b8eeaa774c5abc194f85a0d0e9e0d5de39cab79b66 WatchSource:0}: Error finding container 84a93d608bf9460e820f36b8eeaa774c5abc194f85a0d0e9e0d5de39cab79b66: Status 404 returned error can't find the container with id 84a93d608bf9460e820f36b8eeaa774c5abc194f85a0d0e9e0d5de39cab79b66 Jul 21 02:14:47.224218 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.224205 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 02:14:47.903996 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:47.903963 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" event={"ID":"1b64de6f-9e9b-4ecc-80ec-546b74692635","Type":"ContainerStarted","Data":"84a93d608bf9460e820f36b8eeaa774c5abc194f85a0d0e9e0d5de39cab79b66"} Jul 21 02:14:50.386199 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:50.386153 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:14:50.386488 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:50.386236 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:14:50.386488 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:50.386286 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:14:50.921439 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:50.921404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" event={"ID":"1b64de6f-9e9b-4ecc-80ec-546b74692635","Type":"ContainerStarted","Data":"29a54bc095c6c74881175d865774c45ea2c0db760489518addfddfe6aa344463"} Jul 21 02:14:50.945541 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:50.945493 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" podStartSLOduration=1.783908162 podStartE2EDuration="4.945479539s" totalImagesPullingTime="3.161571377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:14:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:14:50.943717936 +0000 UTC m=+323.866397041" watchObservedRunningTime="2026-07-21 02:14:50.945479539 +0000 UTC m=+323.868158645" Jul 21 02:14:51.078208 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:51.078186 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:51.082302 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:51.082281 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:51.927227 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:51.927199 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:14:51.928184 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:14:51.928163 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-554689689dv7mfq" Jul 21 02:15:28.117602 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.117566 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:15:28.207083 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.207055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:15:28.242761 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.242730 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dclx2"] Jul 21 02:15:28.253043 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.253019 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" Jul 21 02:15:28.256289 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.256242 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dclx2"] Jul 21 02:15:28.256892 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.256874 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 02:15:28.257039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.257019 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 02:15:28.258477 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.258453 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-v9slz\"" Jul 21 02:15:28.368289 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.368188 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:15:28.373873 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.373852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f9jq\" (UniqueName: \"kubernetes.io/projected/b951bd9c-282b-410c-a00c-01147ba0b1c7-kube-api-access-8f9jq\") pod \"kuadrant-operator-catalog-dclx2\" (UID: \"b951bd9c-282b-410c-a00c-01147ba0b1c7\") " pod="kuadrant-system/kuadrant-operator-catalog-dclx2" Jul 21 02:15:28.474982 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.474950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f9jq\" (UniqueName: \"kubernetes.io/projected/b951bd9c-282b-410c-a00c-01147ba0b1c7-kube-api-access-8f9jq\") pod \"kuadrant-operator-catalog-dclx2\" (UID: \"b951bd9c-282b-410c-a00c-01147ba0b1c7\") " pod="kuadrant-system/kuadrant-operator-catalog-dclx2" Jul 21 02:15:28.484039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.484010 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f9jq\" (UniqueName: \"kubernetes.io/projected/b951bd9c-282b-410c-a00c-01147ba0b1c7-kube-api-access-8f9jq\") pod \"kuadrant-operator-catalog-dclx2\" (UID: \"b951bd9c-282b-410c-a00c-01147ba0b1c7\") " pod="kuadrant-system/kuadrant-operator-catalog-dclx2" Jul 21 02:15:28.563525 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.563504 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" Jul 21 02:15:28.607469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.607432 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dclx2"] Jul 21 02:15:28.691551 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.691529 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dclx2"] Jul 21 02:15:28.693587 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:15:28.693555 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb951bd9c_282b_410c_a00c_01147ba0b1c7.slice/crio-4b8b8ace1869c67487cddff40480344f1d3c6f8fe0ce523e11b4a062371827c2 WatchSource:0}: Error finding container 4b8b8ace1869c67487cddff40480344f1d3c6f8fe0ce523e11b4a062371827c2: Status 404 returned error can't find the container with id 4b8b8ace1869c67487cddff40480344f1d3c6f8fe0ce523e11b4a062371827c2 Jul 21 02:15:28.818719 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.818692 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4qg"] Jul 21 02:15:28.823397 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.823382 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:28.831295 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.831272 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4qg"] Jul 21 02:15:28.878448 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.878419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rrzz\" (UniqueName: \"kubernetes.io/projected/fedd4bc8-0378-479b-9f76-3996152cba11-kube-api-access-9rrzz\") pod \"kuadrant-operator-catalog-8q4qg\" (UID: \"fedd4bc8-0378-479b-9f76-3996152cba11\") " pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:28.979037 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.978967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rrzz\" (UniqueName: \"kubernetes.io/projected/fedd4bc8-0378-479b-9f76-3996152cba11-kube-api-access-9rrzz\") pod \"kuadrant-operator-catalog-8q4qg\" (UID: \"fedd4bc8-0378-479b-9f76-3996152cba11\") " pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:28.988897 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:28.988878 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rrzz\" (UniqueName: \"kubernetes.io/projected/fedd4bc8-0378-479b-9f76-3996152cba11-kube-api-access-9rrzz\") pod \"kuadrant-operator-catalog-8q4qg\" (UID: \"fedd4bc8-0378-479b-9f76-3996152cba11\") " pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:29.101304 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:29.101248 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" event={"ID":"b951bd9c-282b-410c-a00c-01147ba0b1c7","Type":"ContainerStarted","Data":"4b8b8ace1869c67487cddff40480344f1d3c6f8fe0ce523e11b4a062371827c2"} Jul 21 02:15:29.133815 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:29.133786 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:29.264489 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:29.264465 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8q4qg"] Jul 21 02:15:29.319863 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:15:29.319834 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfedd4bc8_0378_479b_9f76_3996152cba11.slice/crio-bfd72249873ecd970c766a67382faa2f48fb843cf7daa94d5bf2302b1563ab54 WatchSource:0}: Error finding container bfd72249873ecd970c766a67382faa2f48fb843cf7daa94d5bf2302b1563ab54: Status 404 returned error can't find the container with id bfd72249873ecd970c766a67382faa2f48fb843cf7daa94d5bf2302b1563ab54 Jul 21 02:15:30.108630 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:30.108593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" event={"ID":"fedd4bc8-0378-479b-9f76-3996152cba11","Type":"ContainerStarted","Data":"bfd72249873ecd970c766a67382faa2f48fb843cf7daa94d5bf2302b1563ab54"} Jul 21 02:15:31.115002 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.114908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" event={"ID":"fedd4bc8-0378-479b-9f76-3996152cba11","Type":"ContainerStarted","Data":"0b3cd92d1fc8ade350b8f20ddb4a918cb020aa514ffbf05d254028db26677485"} Jul 21 02:15:31.116321 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.116298 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" event={"ID":"b951bd9c-282b-410c-a00c-01147ba0b1c7","Type":"ContainerStarted","Data":"9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf"} Jul 21 02:15:31.116430 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.116374 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" podUID="b951bd9c-282b-410c-a00c-01147ba0b1c7" containerName="registry-server" containerID="cri-o://9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf" gracePeriod=2 Jul 21 02:15:31.134990 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.134950 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" podStartSLOduration=1.6677090209999998 podStartE2EDuration="3.13493681s" totalImagesPullingTime="1.467227789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:15:31.132801495 +0000 UTC m=+364.055480601" watchObservedRunningTime="2026-07-21 02:15:31.13493681 +0000 UTC m=+364.057615939" Jul 21 02:15:31.151832 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.151787 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" podStartSLOduration=1.060841893 podStartE2EDuration="3.151774297s" totalImagesPullingTime="2.090932404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:15:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:15:31.151155345 +0000 UTC m=+364.073834479" watchObservedRunningTime="2026-07-21 02:15:31.151774297 +0000 UTC m=+364.074453403" Jul 21 02:15:31.356126 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.356100 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" Jul 21 02:15:31.402441 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.402375 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f9jq\" (UniqueName: \"kubernetes.io/projected/b951bd9c-282b-410c-a00c-01147ba0b1c7-kube-api-access-8f9jq\") pod \"b951bd9c-282b-410c-a00c-01147ba0b1c7\" (UID: \"b951bd9c-282b-410c-a00c-01147ba0b1c7\") " Jul 21 02:15:31.404425 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.404402 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b951bd9c-282b-410c-a00c-01147ba0b1c7-kube-api-access-8f9jq" (OuterVolumeSpecName: "kube-api-access-8f9jq") pod "b951bd9c-282b-410c-a00c-01147ba0b1c7" (UID: "b951bd9c-282b-410c-a00c-01147ba0b1c7"). InnerVolumeSpecName "kube-api-access-8f9jq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:15:31.503247 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:31.503217 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f9jq\" (UniqueName: \"kubernetes.io/projected/b951bd9c-282b-410c-a00c-01147ba0b1c7-kube-api-access-8f9jq\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:32.122268 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.122178 2565 generic.go:356] "Generic (PLEG): container finished" podID="b951bd9c-282b-410c-a00c-01147ba0b1c7" containerID="9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf" exitCode=0 Jul 21 02:15:32.122629 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.122302 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" Jul 21 02:15:32.132138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.129679 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" event={"ID":"b951bd9c-282b-410c-a00c-01147ba0b1c7","Type":"ContainerDied","Data":"9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf"} Jul 21 02:15:32.132138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.129736 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dclx2" event={"ID":"b951bd9c-282b-410c-a00c-01147ba0b1c7","Type":"ContainerDied","Data":"4b8b8ace1869c67487cddff40480344f1d3c6f8fe0ce523e11b4a062371827c2"} Jul 21 02:15:32.132138 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.129764 2565 scope.go:117] "RemoveContainer" containerID="9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf" Jul 21 02:15:32.143594 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.143577 2565 scope.go:117] "RemoveContainer" containerID="9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf" Jul 21 02:15:32.143852 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:15:32.143833 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf\": container with ID starting with 9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf not found: ID does not exist" containerID="9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf" Jul 21 02:15:32.143921 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.143864 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf"} err="failed to get container status \"9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf\": rpc error: code = NotFound desc = could not find container \"9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf\": container with ID starting with 9b5442593127e466231de8f37d61b2cf329256830bf235598d9908d98ea50fdf not found: ID does not exist" Jul 21 02:15:32.155532 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.155510 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dclx2"] Jul 21 02:15:32.161181 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:32.161161 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dclx2"] Jul 21 02:15:34.126481 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:34.126441 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b951bd9c-282b-410c-a00c-01147ba0b1c7" path="/var/lib/kubelet/pods/b951bd9c-282b-410c-a00c-01147ba0b1c7/volumes" Jul 21 02:15:35.350860 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:35.350828 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:15:35.452192 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:35.452161 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:15:37.220573 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:37.220541 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:15:37.287905 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:37.287876 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:15:39.134193 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:39.134157 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:39.134678 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:39.134246 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:39.156130 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:39.156106 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:39.177881 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:39.177859 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8q4qg" Jul 21 02:15:43.218000 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.217972 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b"] Jul 21 02:15:43.218399 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.218338 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b951bd9c-282b-410c-a00c-01147ba0b1c7" containerName="registry-server" Jul 21 02:15:43.218399 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.218349 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b951bd9c-282b-410c-a00c-01147ba0b1c7" containerName="registry-server" Jul 21 02:15:43.218477 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.218410 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b951bd9c-282b-410c-a00c-01147ba0b1c7" containerName="registry-server" Jul 21 02:15:43.222991 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.222974 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.225990 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.225968 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kvkt4\"" Jul 21 02:15:43.229714 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.229688 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b"] Jul 21 02:15:43.302548 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.302519 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5l2\" (UniqueName: \"kubernetes.io/projected/d698df2e-cc5a-4306-842c-95cc84b3a81e-kube-api-access-vk5l2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.302666 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.302576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.302666 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.302615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.403414 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.403386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.403547 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.403420 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.403547 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.403475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5l2\" (UniqueName: \"kubernetes.io/projected/d698df2e-cc5a-4306-842c-95cc84b3a81e-kube-api-access-vk5l2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.403805 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.403785 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.403844 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.403810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.412456 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.412435 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5l2\" (UniqueName: \"kubernetes.io/projected/d698df2e-cc5a-4306-842c-95cc84b3a81e-kube-api-access-vk5l2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.533164 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.533139 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:43.680427 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:43.680405 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b"] Jul 21 02:15:43.682988 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:15:43.682957 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd698df2e_cc5a_4306_842c_95cc84b3a81e.slice/crio-0bfb23eb5d2046314e57b7fa79d720ccf39e7a56589181db956dde9fff8b0064 WatchSource:0}: Error finding container 0bfb23eb5d2046314e57b7fa79d720ccf39e7a56589181db956dde9fff8b0064: Status 404 returned error can't find the container with id 0bfb23eb5d2046314e57b7fa79d720ccf39e7a56589181db956dde9fff8b0064 Jul 21 02:15:44.065218 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.065145 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv"] Jul 21 02:15:44.068643 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.068622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.082652 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.082629 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv"] Jul 21 02:15:44.179350 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.179318 2565 generic.go:356] "Generic (PLEG): container finished" podID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerID="c04dbc8ec6e7b2278c7d23bc9dcaf82ce5fd030703c66fcff38950525147143e" exitCode=0 Jul 21 02:15:44.179523 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.179357 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" event={"ID":"d698df2e-cc5a-4306-842c-95cc84b3a81e","Type":"ContainerDied","Data":"c04dbc8ec6e7b2278c7d23bc9dcaf82ce5fd030703c66fcff38950525147143e"} Jul 21 02:15:44.179523 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.179425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" event={"ID":"d698df2e-cc5a-4306-842c-95cc84b3a81e","Type":"ContainerStarted","Data":"0bfb23eb5d2046314e57b7fa79d720ccf39e7a56589181db956dde9fff8b0064"} Jul 21 02:15:44.210971 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.210947 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.211089 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.210999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.211089 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.211019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j5t5\" (UniqueName: \"kubernetes.io/projected/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-kube-api-access-5j5t5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.311980 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.311950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.312447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.312019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.312447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.312050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j5t5\" (UniqueName: \"kubernetes.io/projected/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-kube-api-access-5j5t5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.312447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.312314 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.312447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.312341 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.321592 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.321544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j5t5\" (UniqueName: \"kubernetes.io/projected/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-kube-api-access-5j5t5\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.377460 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.377439 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:44.505951 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.505921 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv"] Jul 21 02:15:44.506650 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:15:44.506629 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b205e1a_d13a_4163_89c8_e296b6ac8e1d.slice/crio-d1587a08e3e8d68a838f78d104d3cbbf8464deb26ef6a28bf1ddf5c2164dd4c7 WatchSource:0}: Error finding container d1587a08e3e8d68a838f78d104d3cbbf8464deb26ef6a28bf1ddf5c2164dd4c7: Status 404 returned error can't find the container with id d1587a08e3e8d68a838f78d104d3cbbf8464deb26ef6a28bf1ddf5c2164dd4c7 Jul 21 02:15:44.614075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.614052 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw"] Jul 21 02:15:44.617737 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.617721 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.626029 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.626006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw"] Jul 21 02:15:44.715314 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.715250 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.715445 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.715321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.715445 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.715358 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77fwq\" (UniqueName: \"kubernetes.io/projected/ce870562-8c97-4f9a-a9a9-1d34c9453638-kube-api-access-77fwq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.816663 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.816636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.816816 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.816668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.816816 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.816695 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77fwq\" (UniqueName: \"kubernetes.io/projected/ce870562-8c97-4f9a-a9a9-1d34c9453638-kube-api-access-77fwq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.817037 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.817017 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.817100 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.817052 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.825570 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.825553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77fwq\" (UniqueName: \"kubernetes.io/projected/ce870562-8c97-4f9a-a9a9-1d34c9453638-kube-api-access-77fwq\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:44.977871 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:44.977797 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:45.022832 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.022802 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h"] Jul 21 02:15:45.028177 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.028152 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.040223 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.040200 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h"] Jul 21 02:15:45.109608 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.109581 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw"] Jul 21 02:15:45.116077 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:15:45.116055 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce870562_8c97_4f9a_a9a9_1d34c9453638.slice/crio-ad144672d1d42ff456e6c822afdd44d7113553ea56cdf083d2a61a2c5bf42a28 WatchSource:0}: Error finding container ad144672d1d42ff456e6c822afdd44d7113553ea56cdf083d2a61a2c5bf42a28: Status 404 returned error can't find the container with id ad144672d1d42ff456e6c822afdd44d7113553ea56cdf083d2a61a2c5bf42a28 Jul 21 02:15:45.119935 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.119915 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.120044 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.120028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.120113 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.120060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngj94\" (UniqueName: \"kubernetes.io/projected/4555acaf-3af4-4f63-8947-d842a59886ec-kube-api-access-ngj94\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.190442 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.190354 2565 generic.go:356] "Generic (PLEG): container finished" podID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerID="9f31b86d0a7b4203af87c15a974aa9cc6619cff8c5d80edbb9408faaeaaf9873" exitCode=0 Jul 21 02:15:45.190588 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.190470 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" event={"ID":"9b205e1a-d13a-4163-89c8-e296b6ac8e1d","Type":"ContainerDied","Data":"9f31b86d0a7b4203af87c15a974aa9cc6619cff8c5d80edbb9408faaeaaf9873"} Jul 21 02:15:45.190588 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.190513 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" event={"ID":"9b205e1a-d13a-4163-89c8-e296b6ac8e1d","Type":"ContainerStarted","Data":"d1587a08e3e8d68a838f78d104d3cbbf8464deb26ef6a28bf1ddf5c2164dd4c7"} Jul 21 02:15:45.192677 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.192649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" event={"ID":"ce870562-8c97-4f9a-a9a9-1d34c9453638","Type":"ContainerStarted","Data":"39189cb71bf3b4e86aad9c630880805a13493a5dce202adecda8d35d8a2b7884"} Jul 21 02:15:45.192796 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.192689 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" event={"ID":"ce870562-8c97-4f9a-a9a9-1d34c9453638","Type":"ContainerStarted","Data":"ad144672d1d42ff456e6c822afdd44d7113553ea56cdf083d2a61a2c5bf42a28"} Jul 21 02:15:45.220965 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.220938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.221124 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.220976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngj94\" (UniqueName: \"kubernetes.io/projected/4555acaf-3af4-4f63-8947-d842a59886ec-kube-api-access-ngj94\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.221124 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.221033 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.221403 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.221387 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.221480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.221402 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.229607 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.229557 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngj94\" (UniqueName: \"kubernetes.io/projected/4555acaf-3af4-4f63-8947-d842a59886ec-kube-api-access-ngj94\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.341087 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.341060 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:45.470530 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:45.470505 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h"] Jul 21 02:15:45.472246 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:15:45.472220 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4555acaf_3af4_4f63_8947_d842a59886ec.slice/crio-8b7bc33f63b49c378478c3290c35244a3d96c6c9e9a26ae97fad5c77472581b2 WatchSource:0}: Error finding container 8b7bc33f63b49c378478c3290c35244a3d96c6c9e9a26ae97fad5c77472581b2: Status 404 returned error can't find the container with id 8b7bc33f63b49c378478c3290c35244a3d96c6c9e9a26ae97fad5c77472581b2 Jul 21 02:15:46.200426 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.200399 2565 generic.go:356] "Generic (PLEG): container finished" podID="4555acaf-3af4-4f63-8947-d842a59886ec" containerID="480faa0adf78330f0e1119e405bc9bb5e0d0f4f5a55a9cc3993870a75628befa" exitCode=0 Jul 21 02:15:46.200535 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.200493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" event={"ID":"4555acaf-3af4-4f63-8947-d842a59886ec","Type":"ContainerDied","Data":"480faa0adf78330f0e1119e405bc9bb5e0d0f4f5a55a9cc3993870a75628befa"} Jul 21 02:15:46.200589 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.200539 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" event={"ID":"4555acaf-3af4-4f63-8947-d842a59886ec","Type":"ContainerStarted","Data":"8b7bc33f63b49c378478c3290c35244a3d96c6c9e9a26ae97fad5c77472581b2"} Jul 21 02:15:46.202518 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.202492 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" event={"ID":"9b205e1a-d13a-4163-89c8-e296b6ac8e1d","Type":"ContainerStarted","Data":"e08c62413853be41236f5caff79fe5ba9641a1d1b40ccfd1623b3a77d3e535a0"} Jul 21 02:15:46.204500 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.204384 2565 generic.go:356] "Generic (PLEG): container finished" podID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerID="bfa96f25a29478b964c2a4d72962b209e1a783ef117b18607374349344bcc014" exitCode=0 Jul 21 02:15:46.204595 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.204569 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" event={"ID":"d698df2e-cc5a-4306-842c-95cc84b3a81e","Type":"ContainerDied","Data":"bfa96f25a29478b964c2a4d72962b209e1a783ef117b18607374349344bcc014"} Jul 21 02:15:46.206206 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.206177 2565 generic.go:356] "Generic (PLEG): container finished" podID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerID="39189cb71bf3b4e86aad9c630880805a13493a5dce202adecda8d35d8a2b7884" exitCode=0 Jul 21 02:15:46.206314 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:46.206210 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" event={"ID":"ce870562-8c97-4f9a-a9a9-1d34c9453638","Type":"ContainerDied","Data":"39189cb71bf3b4e86aad9c630880805a13493a5dce202adecda8d35d8a2b7884"} Jul 21 02:15:47.214042 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:47.214007 2565 generic.go:356] "Generic (PLEG): container finished" podID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerID="13ebbc730be5989aa5d3e6b4f88ccc3b490a230aa8b343e4916c5f2072c277d4" exitCode=0 Jul 21 02:15:47.214404 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:47.214116 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" event={"ID":"d698df2e-cc5a-4306-842c-95cc84b3a81e","Type":"ContainerDied","Data":"13ebbc730be5989aa5d3e6b4f88ccc3b490a230aa8b343e4916c5f2072c277d4"} Jul 21 02:15:47.215840 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:47.215818 2565 generic.go:356] "Generic (PLEG): container finished" podID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerID="14e5276b702b3414569904a5847a25817573f28f7a692051d5c3d2f80634c293" exitCode=0 Jul 21 02:15:47.215945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:47.215896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" event={"ID":"ce870562-8c97-4f9a-a9a9-1d34c9453638","Type":"ContainerDied","Data":"14e5276b702b3414569904a5847a25817573f28f7a692051d5c3d2f80634c293"} Jul 21 02:15:47.217747 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:47.217724 2565 generic.go:356] "Generic (PLEG): container finished" podID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerID="e08c62413853be41236f5caff79fe5ba9641a1d1b40ccfd1623b3a77d3e535a0" exitCode=0 Jul 21 02:15:47.217844 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:47.217749 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" event={"ID":"9b205e1a-d13a-4163-89c8-e296b6ac8e1d","Type":"ContainerDied","Data":"e08c62413853be41236f5caff79fe5ba9641a1d1b40ccfd1623b3a77d3e535a0"} Jul 21 02:15:48.224376 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.224343 2565 generic.go:356] "Generic (PLEG): container finished" podID="4555acaf-3af4-4f63-8947-d842a59886ec" containerID="5377ccb9ed3a85df992a3fea6b940eb1a48c5331418bc6406f48dd1719d53098" exitCode=0 Jul 21 02:15:48.224803 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.224428 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" event={"ID":"4555acaf-3af4-4f63-8947-d842a59886ec","Type":"ContainerDied","Data":"5377ccb9ed3a85df992a3fea6b940eb1a48c5331418bc6406f48dd1719d53098"} Jul 21 02:15:48.226674 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.226650 2565 generic.go:356] "Generic (PLEG): container finished" podID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerID="91dee85b3b12ba20b1df1f9873e08ec8ded4f30cb11ac9d1921f57c6a5c25ebc" exitCode=0 Jul 21 02:15:48.226755 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.226726 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" event={"ID":"9b205e1a-d13a-4163-89c8-e296b6ac8e1d","Type":"ContainerDied","Data":"91dee85b3b12ba20b1df1f9873e08ec8ded4f30cb11ac9d1921f57c6a5c25ebc"} Jul 21 02:15:48.228789 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.228768 2565 generic.go:356] "Generic (PLEG): container finished" podID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerID="d846d655f3d8f08f7c4124e19757839d9be4e97b918a4d1258800bb5e064b849" exitCode=0 Jul 21 02:15:48.228883 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.228844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" event={"ID":"ce870562-8c97-4f9a-a9a9-1d34c9453638","Type":"ContainerDied","Data":"d846d655f3d8f08f7c4124e19757839d9be4e97b918a4d1258800bb5e064b849"} Jul 21 02:15:48.357634 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.357608 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:48.449179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.449150 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-bundle\") pod \"d698df2e-cc5a-4306-842c-95cc84b3a81e\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " Jul 21 02:15:48.449369 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.449190 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vk5l2\" (UniqueName: \"kubernetes.io/projected/d698df2e-cc5a-4306-842c-95cc84b3a81e-kube-api-access-vk5l2\") pod \"d698df2e-cc5a-4306-842c-95cc84b3a81e\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " Jul 21 02:15:48.449369 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.449247 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-util\") pod \"d698df2e-cc5a-4306-842c-95cc84b3a81e\" (UID: \"d698df2e-cc5a-4306-842c-95cc84b3a81e\") " Jul 21 02:15:48.449663 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.449641 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-bundle" (OuterVolumeSpecName: "bundle") pod "d698df2e-cc5a-4306-842c-95cc84b3a81e" (UID: "d698df2e-cc5a-4306-842c-95cc84b3a81e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:48.451163 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.451140 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d698df2e-cc5a-4306-842c-95cc84b3a81e-kube-api-access-vk5l2" (OuterVolumeSpecName: "kube-api-access-vk5l2") pod "d698df2e-cc5a-4306-842c-95cc84b3a81e" (UID: "d698df2e-cc5a-4306-842c-95cc84b3a81e"). InnerVolumeSpecName "kube-api-access-vk5l2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:15:48.454677 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.454658 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-util" (OuterVolumeSpecName: "util") pod "d698df2e-cc5a-4306-842c-95cc84b3a81e" (UID: "d698df2e-cc5a-4306-842c-95cc84b3a81e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:48.550376 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.550353 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:48.550376 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.550373 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vk5l2\" (UniqueName: \"kubernetes.io/projected/d698df2e-cc5a-4306-842c-95cc84b3a81e-kube-api-access-vk5l2\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:48.550510 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:48.550383 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d698df2e-cc5a-4306-842c-95cc84b3a81e-util\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:49.235618 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.235583 2565 generic.go:356] "Generic (PLEG): container finished" podID="4555acaf-3af4-4f63-8947-d842a59886ec" containerID="256678be459b1a9318ee8bb127c7175374aec236a87d0193fd6808379b43c3a7" exitCode=0 Jul 21 02:15:49.236028 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.235673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" event={"ID":"4555acaf-3af4-4f63-8947-d842a59886ec","Type":"ContainerDied","Data":"256678be459b1a9318ee8bb127c7175374aec236a87d0193fd6808379b43c3a7"} Jul 21 02:15:49.237557 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.237537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" event={"ID":"d698df2e-cc5a-4306-842c-95cc84b3a81e","Type":"ContainerDied","Data":"0bfb23eb5d2046314e57b7fa79d720ccf39e7a56589181db956dde9fff8b0064"} Jul 21 02:15:49.237660 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.237570 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bfb23eb5d2046314e57b7fa79d720ccf39e7a56589181db956dde9fff8b0064" Jul 21 02:15:49.237660 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.237574 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b" Jul 21 02:15:49.378792 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.378761 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:49.394203 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.394183 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:49.560584 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.560556 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j5t5\" (UniqueName: \"kubernetes.io/projected/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-kube-api-access-5j5t5\") pod \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " Jul 21 02:15:49.560584 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.560588 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-bundle\") pod \"ce870562-8c97-4f9a-a9a9-1d34c9453638\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " Jul 21 02:15:49.560820 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.560603 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77fwq\" (UniqueName: \"kubernetes.io/projected/ce870562-8c97-4f9a-a9a9-1d34c9453638-kube-api-access-77fwq\") pod \"ce870562-8c97-4f9a-a9a9-1d34c9453638\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " Jul 21 02:15:49.560820 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.560629 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-util\") pod \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " Jul 21 02:15:49.560820 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.560644 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-util\") pod \"ce870562-8c97-4f9a-a9a9-1d34c9453638\" (UID: \"ce870562-8c97-4f9a-a9a9-1d34c9453638\") " Jul 21 02:15:49.560820 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.560719 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-bundle\") pod \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\" (UID: \"9b205e1a-d13a-4163-89c8-e296b6ac8e1d\") " Jul 21 02:15:49.561381 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.561345 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-bundle" (OuterVolumeSpecName: "bundle") pod "ce870562-8c97-4f9a-a9a9-1d34c9453638" (UID: "ce870562-8c97-4f9a-a9a9-1d34c9453638"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:49.561624 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.561594 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-bundle" (OuterVolumeSpecName: "bundle") pod "9b205e1a-d13a-4163-89c8-e296b6ac8e1d" (UID: "9b205e1a-d13a-4163-89c8-e296b6ac8e1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:49.562715 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.562687 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-kube-api-access-5j5t5" (OuterVolumeSpecName: "kube-api-access-5j5t5") pod "9b205e1a-d13a-4163-89c8-e296b6ac8e1d" (UID: "9b205e1a-d13a-4163-89c8-e296b6ac8e1d"). InnerVolumeSpecName "kube-api-access-5j5t5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:15:49.562715 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.562701 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce870562-8c97-4f9a-a9a9-1d34c9453638-kube-api-access-77fwq" (OuterVolumeSpecName: "kube-api-access-77fwq") pod "ce870562-8c97-4f9a-a9a9-1d34c9453638" (UID: "ce870562-8c97-4f9a-a9a9-1d34c9453638"). InnerVolumeSpecName "kube-api-access-77fwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:15:49.565419 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.565388 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-util" (OuterVolumeSpecName: "util") pod "9b205e1a-d13a-4163-89c8-e296b6ac8e1d" (UID: "9b205e1a-d13a-4163-89c8-e296b6ac8e1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:49.568981 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.568954 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-util" (OuterVolumeSpecName: "util") pod "ce870562-8c97-4f9a-a9a9-1d34c9453638" (UID: "ce870562-8c97-4f9a-a9a9-1d34c9453638"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:49.662095 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.662068 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:49.662233 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.662092 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j5t5\" (UniqueName: \"kubernetes.io/projected/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-kube-api-access-5j5t5\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:49.662233 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.662113 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:49.662233 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.662122 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77fwq\" (UniqueName: \"kubernetes.io/projected/ce870562-8c97-4f9a-a9a9-1d34c9453638-kube-api-access-77fwq\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:49.662233 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.662131 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9b205e1a-d13a-4163-89c8-e296b6ac8e1d-util\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:49.662233 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:49.662140 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce870562-8c97-4f9a-a9a9-1d34c9453638-util\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:50.244434 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.244412 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" Jul 21 02:15:50.244896 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.244442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv" event={"ID":"9b205e1a-d13a-4163-89c8-e296b6ac8e1d","Type":"ContainerDied","Data":"d1587a08e3e8d68a838f78d104d3cbbf8464deb26ef6a28bf1ddf5c2164dd4c7"} Jul 21 02:15:50.244896 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.244488 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1587a08e3e8d68a838f78d104d3cbbf8464deb26ef6a28bf1ddf5c2164dd4c7" Jul 21 02:15:50.246374 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.246353 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" Jul 21 02:15:50.246493 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.246391 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw" event={"ID":"ce870562-8c97-4f9a-a9a9-1d34c9453638","Type":"ContainerDied","Data":"ad144672d1d42ff456e6c822afdd44d7113553ea56cdf083d2a61a2c5bf42a28"} Jul 21 02:15:50.246493 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.246436 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad144672d1d42ff456e6c822afdd44d7113553ea56cdf083d2a61a2c5bf42a28" Jul 21 02:15:50.372303 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.372281 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:50.468824 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.468756 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-bundle\") pod \"4555acaf-3af4-4f63-8947-d842a59886ec\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " Jul 21 02:15:50.468824 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.468786 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-util\") pod \"4555acaf-3af4-4f63-8947-d842a59886ec\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " Jul 21 02:15:50.468824 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.468804 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngj94\" (UniqueName: \"kubernetes.io/projected/4555acaf-3af4-4f63-8947-d842a59886ec-kube-api-access-ngj94\") pod \"4555acaf-3af4-4f63-8947-d842a59886ec\" (UID: \"4555acaf-3af4-4f63-8947-d842a59886ec\") " Jul 21 02:15:50.469308 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.469247 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-bundle" (OuterVolumeSpecName: "bundle") pod "4555acaf-3af4-4f63-8947-d842a59886ec" (UID: "4555acaf-3af4-4f63-8947-d842a59886ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:50.470755 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.470733 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4555acaf-3af4-4f63-8947-d842a59886ec-kube-api-access-ngj94" (OuterVolumeSpecName: "kube-api-access-ngj94") pod "4555acaf-3af4-4f63-8947-d842a59886ec" (UID: "4555acaf-3af4-4f63-8947-d842a59886ec"). InnerVolumeSpecName "kube-api-access-ngj94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:15:50.474179 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.474160 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-util" (OuterVolumeSpecName: "util") pod "4555acaf-3af4-4f63-8947-d842a59886ec" (UID: "4555acaf-3af4-4f63-8947-d842a59886ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:15:50.569516 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.569493 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:50.569516 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.569513 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4555acaf-3af4-4f63-8947-d842a59886ec-util\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:50.569642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:50.569522 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngj94\" (UniqueName: \"kubernetes.io/projected/4555acaf-3af4-4f63-8947-d842a59886ec-kube-api-access-ngj94\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:15:51.252513 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:51.252487 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" Jul 21 02:15:51.252904 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:51.252489 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h" event={"ID":"4555acaf-3af4-4f63-8947-d842a59886ec","Type":"ContainerDied","Data":"8b7bc33f63b49c378478c3290c35244a3d96c6c9e9a26ae97fad5c77472581b2"} Jul 21 02:15:51.252904 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:51.252607 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b7bc33f63b49c378478c3290c35244a3d96c6c9e9a26ae97fad5c77472581b2" Jul 21 02:15:57.305209 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:15:57.305178 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:00.457515 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:00.457482 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:01.879581 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879550 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n"] Jul 21 02:16:01.879957 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879930 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerName="pull" Jul 21 02:16:01.879957 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879942 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerName="pull" Jul 21 02:16:01.879957 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879954 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerName="extract" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879963 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerName="extract" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879974 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4555acaf-3af4-4f63-8947-d842a59886ec" containerName="extract" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879980 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4555acaf-3af4-4f63-8947-d842a59886ec" containerName="extract" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879987 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerName="util" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.879992 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerName="util" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880004 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerName="util" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880008 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerName="util" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880014 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerName="util" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880019 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerName="util" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880025 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerName="pull" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880030 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerName="pull" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880042 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerName="pull" Jul 21 02:16:01.880054 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880048 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerName="pull" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880062 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerName="extract" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880067 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerName="extract" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880074 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4555acaf-3af4-4f63-8947-d842a59886ec" containerName="util" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880079 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4555acaf-3af4-4f63-8947-d842a59886ec" containerName="util" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880084 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerName="extract" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880088 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerName="extract" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880099 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4555acaf-3af4-4f63-8947-d842a59886ec" containerName="pull" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880104 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4555acaf-3af4-4f63-8947-d842a59886ec" containerName="pull" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880162 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4555acaf-3af4-4f63-8947-d842a59886ec" containerName="extract" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880171 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d698df2e-cc5a-4306-842c-95cc84b3a81e" containerName="extract" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880177 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b205e1a-d13a-4163-89c8-e296b6ac8e1d" containerName="extract" Jul 21 02:16:01.880465 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.880184 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce870562-8c97-4f9a-a9a9-1d34c9453638" containerName="extract" Jul 21 02:16:01.886403 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.886385 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:01.892130 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.892107 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h8n22\"" Jul 21 02:16:01.902752 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.902730 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n"] Jul 21 02:16:01.967676 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.967644 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c648w\" (UniqueName: \"kubernetes.io/projected/d99830bf-cf0d-4315-bda0-04cd833726dc-kube-api-access-c648w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:01.967821 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:01.967688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d99830bf-cf0d-4315-bda0-04cd833726dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:02.068746 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:02.068716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c648w\" (UniqueName: \"kubernetes.io/projected/d99830bf-cf0d-4315-bda0-04cd833726dc-kube-api-access-c648w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:02.068897 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:02.068762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d99830bf-cf0d-4315-bda0-04cd833726dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:02.069110 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:02.069094 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d99830bf-cf0d-4315-bda0-04cd833726dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:02.080193 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:02.080171 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c648w\" (UniqueName: \"kubernetes.io/projected/d99830bf-cf0d-4315-bda0-04cd833726dc-kube-api-access-c648w\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:02.196149 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:02.196073 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:02.338443 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:02.338424 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n"] Jul 21 02:16:02.340829 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:02.340796 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99830bf_cf0d_4315_bda0_04cd833726dc.slice/crio-6d8636e52cb72d584c7c98124745dde88a9be3db75ea6028177e331d6271c541 WatchSource:0}: Error finding container 6d8636e52cb72d584c7c98124745dde88a9be3db75ea6028177e331d6271c541: Status 404 returned error can't find the container with id 6d8636e52cb72d584c7c98124745dde88a9be3db75ea6028177e331d6271c541 Jul 21 02:16:02.590467 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:02.590437 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:03.316866 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:03.316831 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" event={"ID":"d99830bf-cf0d-4315-bda0-04cd833726dc","Type":"ContainerStarted","Data":"6d8636e52cb72d584c7c98124745dde88a9be3db75ea6028177e331d6271c541"} Jul 21 02:16:04.369890 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:04.369860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:04.772630 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:04.772598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:05.054399 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:05.054320 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:07.454683 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.454646 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-747dcf89b6-p977t"] Jul 21 02:16:07.459459 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.459441 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.517729 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.517696 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de5fd979-ddce-47d7-b018-a78628f70729-console-serving-cert\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.517897 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.517740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-oauth-serving-cert\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.517897 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.517810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-console-config\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.518022 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.517912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-service-ca\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.518022 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.517942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de5fd979-ddce-47d7-b018-a78628f70729-console-oauth-config\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.518022 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.517967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-trusted-ca-bundle\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.518131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.518038 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f5m5\" (UniqueName: \"kubernetes.io/projected/de5fd979-ddce-47d7-b018-a78628f70729-kube-api-access-6f5m5\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.544912 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.544882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:07.606818 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.606781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747dcf89b6-p977t"] Jul 21 02:16:07.618924 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.618898 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-service-ca\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.619108 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.618936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de5fd979-ddce-47d7-b018-a78628f70729-console-oauth-config\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.619108 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.618955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-trusted-ca-bundle\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.619249 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.619108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f5m5\" (UniqueName: \"kubernetes.io/projected/de5fd979-ddce-47d7-b018-a78628f70729-kube-api-access-6f5m5\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.619249 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.619181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de5fd979-ddce-47d7-b018-a78628f70729-console-serving-cert\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.619249 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.619236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-oauth-serving-cert\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.619445 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.619301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-console-config\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.619914 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.619727 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-service-ca\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.620034 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.620020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-trusted-ca-bundle\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.620378 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.620356 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-console-config\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.620537 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.620517 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/de5fd979-ddce-47d7-b018-a78628f70729-oauth-serving-cert\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.622112 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.622085 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/de5fd979-ddce-47d7-b018-a78628f70729-console-serving-cert\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.622197 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.622179 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/de5fd979-ddce-47d7-b018-a78628f70729-console-oauth-config\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.638740 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.638695 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f5m5\" (UniqueName: \"kubernetes.io/projected/de5fd979-ddce-47d7-b018-a78628f70729-kube-api-access-6f5m5\") pod \"console-747dcf89b6-p977t\" (UID: \"de5fd979-ddce-47d7-b018-a78628f70729\") " pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.768574 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.768541 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:07.775900 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:07.775861 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:08.073802 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.073718 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w"] Jul 21 02:16:08.077595 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.077569 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" Jul 21 02:16:08.081102 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.081079 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-65dvn\"" Jul 21 02:16:08.097192 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.097159 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w"] Jul 21 02:16:08.124030 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.123991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5vbz\" (UniqueName: \"kubernetes.io/projected/ccc2d777-4bff-42fa-925b-87aa1bf92a55-kube-api-access-c5vbz\") pod \"authorino-operator-75cc8d5cb7-n6w9w\" (UID: \"ccc2d777-4bff-42fa-925b-87aa1bf92a55\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" Jul 21 02:16:08.225480 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.225442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5vbz\" (UniqueName: \"kubernetes.io/projected/ccc2d777-4bff-42fa-925b-87aa1bf92a55-kube-api-access-c5vbz\") pod \"authorino-operator-75cc8d5cb7-n6w9w\" (UID: \"ccc2d777-4bff-42fa-925b-87aa1bf92a55\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" Jul 21 02:16:08.239092 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.239065 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5vbz\" (UniqueName: \"kubernetes.io/projected/ccc2d777-4bff-42fa-925b-87aa1bf92a55-kube-api-access-c5vbz\") pod \"authorino-operator-75cc8d5cb7-n6w9w\" (UID: \"ccc2d777-4bff-42fa-925b-87aa1bf92a55\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" Jul 21 02:16:08.372231 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.372136 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:08.391294 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.391248 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" Jul 21 02:16:08.858928 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.858904 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w"] Jul 21 02:16:08.860509 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:08.860482 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc2d777_4bff_42fa_925b_87aa1bf92a55.slice/crio-b550c3f71f1aeda1a7867e48d0d6b16f4ea02394c58bb25eb45294904817a6f6 WatchSource:0}: Error finding container b550c3f71f1aeda1a7867e48d0d6b16f4ea02394c58bb25eb45294904817a6f6: Status 404 returned error can't find the container with id b550c3f71f1aeda1a7867e48d0d6b16f4ea02394c58bb25eb45294904817a6f6 Jul 21 02:16:08.871723 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:08.871705 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747dcf89b6-p977t"] Jul 21 02:16:08.873125 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:08.873100 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde5fd979_ddce_47d7_b018_a78628f70729.slice/crio-3b3a55ce52a1d92a9b0caa7cc9dbb9f60728555a4d5985e3c25165fad482c5cf WatchSource:0}: Error finding container 3b3a55ce52a1d92a9b0caa7cc9dbb9f60728555a4d5985e3c25165fad482c5cf: Status 404 returned error can't find the container with id 3b3a55ce52a1d92a9b0caa7cc9dbb9f60728555a4d5985e3c25165fad482c5cf Jul 21 02:16:09.233349 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.233312 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:09.353826 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.353792 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" event={"ID":"d99830bf-cf0d-4315-bda0-04cd833726dc","Type":"ContainerStarted","Data":"82ac14a90c69d090e0572d0fa14a39027b17241201b2b8e5841a484916331e9b"} Jul 21 02:16:09.354020 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.353940 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:09.355075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.355049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" event={"ID":"ccc2d777-4bff-42fa-925b-87aa1bf92a55","Type":"ContainerStarted","Data":"b550c3f71f1aeda1a7867e48d0d6b16f4ea02394c58bb25eb45294904817a6f6"} Jul 21 02:16:09.356447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.356426 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747dcf89b6-p977t" event={"ID":"de5fd979-ddce-47d7-b018-a78628f70729","Type":"ContainerStarted","Data":"fc7f53ac6d51fe0238923457e1b6c823b34582e546466a2828023d7c98fdb212"} Jul 21 02:16:09.356534 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.356460 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747dcf89b6-p977t" event={"ID":"de5fd979-ddce-47d7-b018-a78628f70729","Type":"ContainerStarted","Data":"3b3a55ce52a1d92a9b0caa7cc9dbb9f60728555a4d5985e3c25165fad482c5cf"} Jul 21 02:16:09.391356 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.391307 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" podStartSLOduration=1.959056 podStartE2EDuration="8.391291088s" totalImagesPullingTime="6.432235088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:16:09.388387541 +0000 UTC m=+402.311066666" watchObservedRunningTime="2026-07-21 02:16:09.391291088 +0000 UTC m=+402.313970192" Jul 21 02:16:09.435499 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:09.435446 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-747dcf89b6-p977t" podStartSLOduration=2.43542989 podStartE2EDuration="2.43542989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:16:09.435242688 +0000 UTC m=+402.357921823" watchObservedRunningTime="2026-07-21 02:16:09.43542989 +0000 UTC m=+402.358108996" Jul 21 02:16:11.370674 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:11.370641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" event={"ID":"ccc2d777-4bff-42fa-925b-87aa1bf92a55","Type":"ContainerStarted","Data":"5414fc6e2633bafeef49fe0f7d2d1ae04fb6a6f724b0bf8ae7a8e162d0c13403"} Jul 21 02:16:11.370930 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:11.370780 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" Jul 21 02:16:11.401721 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:11.401674 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" podStartSLOduration=0.964005921 podStartE2EDuration="3.401657826s" totalImagesPullingTime="2.437651905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:16:11.400156302 +0000 UTC m=+404.322835411" watchObservedRunningTime="2026-07-21 02:16:11.401657826 +0000 UTC m=+404.324336932" Jul 21 02:16:11.958504 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:11.958469 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:12.156737 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:12.156700 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:12.289176 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:12.289141 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:12.410546 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:12.410516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:17.769361 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:17.769328 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:17.769730 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:17.769422 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:17.774244 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:17.774221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:18.409176 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:18.409150 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-747dcf89b6-p977t" Jul 21 02:16:18.477219 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:18.477186 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7df7c6dc-c2h2s"] Jul 21 02:16:18.603946 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:18.603916 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:18.697370 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:18.697287 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:18.796563 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:18.796525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:20.365750 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:20.365724 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:20.997309 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:20.997276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:21.163097 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:21.163064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:22.206564 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.206534 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n"] Jul 21 02:16:22.207015 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.206778 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" containerName="manager" containerID="cri-o://82ac14a90c69d090e0572d0fa14a39027b17241201b2b8e5841a484916331e9b" gracePeriod=2 Jul 21 02:16:22.209976 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.209952 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n"] Jul 21 02:16:22.211421 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:22.211392 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:22.245575 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.245550 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc"] Jul 21 02:16:22.245965 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.245950 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" containerName="manager" Jul 21 02:16:22.246046 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.245968 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" containerName="manager" Jul 21 02:16:22.246102 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.246051 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" containerName="manager" Jul 21 02:16:22.249358 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.249341 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.267309 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.267285 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc"] Jul 21 02:16:22.303591 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.303558 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj"] Jul 21 02:16:22.308236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.308218 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" Jul 21 02:16:22.319797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.319776 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6nxdj\"" Jul 21 02:16:22.322345 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:22.322313 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:22.334962 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.334935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj"] Jul 21 02:16:22.359741 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.359701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4125f746-f9c7-4437-9a97-a7ce6db73e45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48dmc\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.359933 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.359871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krf4t\" (UniqueName: \"kubernetes.io/projected/4125f746-f9c7-4437-9a97-a7ce6db73e45-kube-api-access-krf4t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48dmc\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.374530 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:22.374500 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:22.377612 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.377584 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n6w9w" Jul 21 02:16:22.428193 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.428164 2565 generic.go:356] "Generic (PLEG): container finished" podID="d99830bf-cf0d-4315-bda0-04cd833726dc" containerID="82ac14a90c69d090e0572d0fa14a39027b17241201b2b8e5841a484916331e9b" exitCode=0 Jul 21 02:16:22.440729 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:22.440701 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:22.460784 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.460724 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krf4t\" (UniqueName: \"kubernetes.io/projected/4125f746-f9c7-4437-9a97-a7ce6db73e45-kube-api-access-krf4t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48dmc\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.460884 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.460813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4125f746-f9c7-4437-9a97-a7ce6db73e45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48dmc\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.460884 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.460871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69cn8\" (UniqueName: \"kubernetes.io/projected/78685cb1-811c-46ff-b6dd-e6c8c562f42e-kube-api-access-69cn8\") pod \"limitador-operator-controller-manager-859d7b78bd-n45hj\" (UID: \"78685cb1-811c-46ff-b6dd-e6c8c562f42e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" Jul 21 02:16:22.461218 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.461195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4125f746-f9c7-4437-9a97-a7ce6db73e45-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48dmc\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.473147 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.473129 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:22.477313 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.477291 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krf4t\" (UniqueName: \"kubernetes.io/projected/4125f746-f9c7-4437-9a97-a7ce6db73e45-kube-api-access-krf4t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-48dmc\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.479083 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:22.479052 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:22.561997 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.561971 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d99830bf-cf0d-4315-bda0-04cd833726dc-extensions-socket-volume\") pod \"d99830bf-cf0d-4315-bda0-04cd833726dc\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " Jul 21 02:16:22.562117 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.562103 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c648w\" (UniqueName: \"kubernetes.io/projected/d99830bf-cf0d-4315-bda0-04cd833726dc-kube-api-access-c648w\") pod \"d99830bf-cf0d-4315-bda0-04cd833726dc\" (UID: \"d99830bf-cf0d-4315-bda0-04cd833726dc\") " Jul 21 02:16:22.562326 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.562307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69cn8\" (UniqueName: \"kubernetes.io/projected/78685cb1-811c-46ff-b6dd-e6c8c562f42e-kube-api-access-69cn8\") pod \"limitador-operator-controller-manager-859d7b78bd-n45hj\" (UID: \"78685cb1-811c-46ff-b6dd-e6c8c562f42e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" Jul 21 02:16:22.562537 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.562515 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99830bf-cf0d-4315-bda0-04cd833726dc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d99830bf-cf0d-4315-bda0-04cd833726dc" (UID: "d99830bf-cf0d-4315-bda0-04cd833726dc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:16:22.564056 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.564032 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99830bf-cf0d-4315-bda0-04cd833726dc-kube-api-access-c648w" (OuterVolumeSpecName: "kube-api-access-c648w") pod "d99830bf-cf0d-4315-bda0-04cd833726dc" (UID: "d99830bf-cf0d-4315-bda0-04cd833726dc"). InnerVolumeSpecName "kube-api-access-c648w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:16:22.579679 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.579658 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:22.580014 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.579991 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69cn8\" (UniqueName: \"kubernetes.io/projected/78685cb1-811c-46ff-b6dd-e6c8c562f42e-kube-api-access-69cn8\") pod \"limitador-operator-controller-manager-859d7b78bd-n45hj\" (UID: \"78685cb1-811c-46ff-b6dd-e6c8c562f42e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" Jul 21 02:16:22.618764 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.618736 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" Jul 21 02:16:22.664213 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.664096 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d99830bf-cf0d-4315-bda0-04cd833726dc-extensions-socket-volume\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:22.664213 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.664132 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c648w\" (UniqueName: \"kubernetes.io/projected/d99830bf-cf0d-4315-bda0-04cd833726dc-kube-api-access-c648w\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:22.751206 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.751183 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc"] Jul 21 02:16:22.753195 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:22.753172 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4125f746_f9c7_4437_9a97_a7ce6db73e45.slice/crio-9d6558b4f3a1bc305c4b13514ab4b6b0f637439e12bc0f9582a7fb0b390e4992 WatchSource:0}: Error finding container 9d6558b4f3a1bc305c4b13514ab4b6b0f637439e12bc0f9582a7fb0b390e4992: Status 404 returned error can't find the container with id 9d6558b4f3a1bc305c4b13514ab4b6b0f637439e12bc0f9582a7fb0b390e4992 Jul 21 02:16:22.785083 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:22.785061 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj"] Jul 21 02:16:22.793276 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:22.793236 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78685cb1_811c_46ff_b6dd_e6c8c562f42e.slice/crio-0640728cde7782a3bc3a8f3a84660c7890d3a7654f6203ddcbd66c18f00c8cf1 WatchSource:0}: Error finding container 0640728cde7782a3bc3a8f3a84660c7890d3a7654f6203ddcbd66c18f00c8cf1: Status 404 returned error can't find the container with id 0640728cde7782a3bc3a8f3a84660c7890d3a7654f6203ddcbd66c18f00c8cf1 Jul 21 02:16:23.437068 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:23.437036 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:23.437068 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:23.437039 2565 scope.go:117] "RemoveContainer" containerID="82ac14a90c69d090e0572d0fa14a39027b17241201b2b8e5841a484916331e9b" Jul 21 02:16:23.439472 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:23.439214 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" event={"ID":"78685cb1-811c-46ff-b6dd-e6c8c562f42e","Type":"ContainerStarted","Data":"0640728cde7782a3bc3a8f3a84660c7890d3a7654f6203ddcbd66c18f00c8cf1"} Jul 21 02:16:23.440992 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:23.440965 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" event={"ID":"4125f746-f9c7-4437-9a97-a7ce6db73e45","Type":"ContainerStarted","Data":"34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99"} Jul 21 02:16:23.441115 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:23.441007 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" event={"ID":"4125f746-f9c7-4437-9a97-a7ce6db73e45","Type":"ContainerStarted","Data":"9d6558b4f3a1bc305c4b13514ab4b6b0f637439e12bc0f9582a7fb0b390e4992"} Jul 21 02:16:23.441437 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:23.441377 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:23.448324 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:23.447959 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:23.509482 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:23.509427 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" podStartSLOduration=1.509403 podStartE2EDuration="1.509403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:16:23.508320331 +0000 UTC m=+416.430999496" watchObservedRunningTime="2026-07-21 02:16:23.509403 +0000 UTC m=+416.432082107" Jul 21 02:16:23.514477 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:23.514445 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:23.518444 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:23.518412 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7845n\" is forbidden: User \"system:node:ip-10-0-137-128.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-128.ec2.internal' and this object" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7845n" Jul 21 02:16:24.128462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:24.128429 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99830bf-cf0d-4315-bda0-04cd833726dc" path="/var/lib/kubelet/pods/d99830bf-cf0d-4315-bda0-04cd833726dc/volumes" Jul 21 02:16:24.448400 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:24.448369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" event={"ID":"78685cb1-811c-46ff-b6dd-e6c8c562f42e","Type":"ContainerStarted","Data":"234574fa8761bafa484f5bde08f59d5e38bb0d99491826d2f1e206ae0d483bb3"} Jul 21 02:16:24.448693 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:24.448446 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" Jul 21 02:16:24.495569 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:24.495525 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" podStartSLOduration=0.908150719 podStartE2EDuration="2.495510166s" totalImagesPullingTime="1.587359447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:16:24.495287711 +0000 UTC m=+417.417966818" watchObservedRunningTime="2026-07-21 02:16:24.495510166 +0000 UTC m=+417.418189272" Jul 21 02:16:25.475301 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:25.475250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:25.609387 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:25.609356 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:25.738920 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:25.738834 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:27.963743 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:27.963706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:28.045535 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:28.045506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:33.727781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:33.727742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:33.830727 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:33.830698 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:34.450507 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:34.450478 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:35.455685 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:35.455653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n45hj" Jul 21 02:16:38.623869 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:38.623827 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc"] Jul 21 02:16:38.624457 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:38.624076 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" podUID="4125f746-f9c7-4437-9a97-a7ce6db73e45" containerName="manager" containerID="cri-o://34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99" gracePeriod=10 Jul 21 02:16:38.870100 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:38.870071 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:38.912093 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:38.912003 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4125f746-f9c7-4437-9a97-a7ce6db73e45-extensions-socket-volume\") pod \"4125f746-f9c7-4437-9a97-a7ce6db73e45\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " Jul 21 02:16:38.912093 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:38.912063 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krf4t\" (UniqueName: \"kubernetes.io/projected/4125f746-f9c7-4437-9a97-a7ce6db73e45-kube-api-access-krf4t\") pod \"4125f746-f9c7-4437-9a97-a7ce6db73e45\" (UID: \"4125f746-f9c7-4437-9a97-a7ce6db73e45\") " Jul 21 02:16:38.912375 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:38.912351 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4125f746-f9c7-4437-9a97-a7ce6db73e45-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4125f746-f9c7-4437-9a97-a7ce6db73e45" (UID: "4125f746-f9c7-4437-9a97-a7ce6db73e45"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:16:38.914118 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:38.914095 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4125f746-f9c7-4437-9a97-a7ce6db73e45-kube-api-access-krf4t" (OuterVolumeSpecName: "kube-api-access-krf4t") pod "4125f746-f9c7-4437-9a97-a7ce6db73e45" (UID: "4125f746-f9c7-4437-9a97-a7ce6db73e45"). InnerVolumeSpecName "kube-api-access-krf4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:16:39.013072 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.013045 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4125f746-f9c7-4437-9a97-a7ce6db73e45-extensions-socket-volume\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:39.013072 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.013069 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krf4t\" (UniqueName: \"kubernetes.io/projected/4125f746-f9c7-4437-9a97-a7ce6db73e45-kube-api-access-krf4t\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:39.534692 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.534656 2565 generic.go:356] "Generic (PLEG): container finished" podID="4125f746-f9c7-4437-9a97-a7ce6db73e45" containerID="34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99" exitCode=0 Jul 21 02:16:39.534899 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.534702 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" Jul 21 02:16:39.534899 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.534750 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" event={"ID":"4125f746-f9c7-4437-9a97-a7ce6db73e45","Type":"ContainerDied","Data":"34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99"} Jul 21 02:16:39.534899 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.534808 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc" event={"ID":"4125f746-f9c7-4437-9a97-a7ce6db73e45","Type":"ContainerDied","Data":"9d6558b4f3a1bc305c4b13514ab4b6b0f637439e12bc0f9582a7fb0b390e4992"} Jul 21 02:16:39.534899 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.534836 2565 scope.go:117] "RemoveContainer" containerID="34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99" Jul 21 02:16:39.544292 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.544250 2565 scope.go:117] "RemoveContainer" containerID="34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99" Jul 21 02:16:39.544550 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:39.544534 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99\": container with ID starting with 34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99 not found: ID does not exist" containerID="34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99" Jul 21 02:16:39.544615 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.544557 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99"} err="failed to get container status \"34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99\": rpc error: code = NotFound desc = could not find container \"34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99\": container with ID starting with 34938dedbc996f7869050ace1e285269dca574f2bd69cfdd29cf67d17bce9f99 not found: ID does not exist" Jul 21 02:16:39.558445 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.558423 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc"] Jul 21 02:16:39.564563 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:39.564544 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-48dmc"] Jul 21 02:16:40.126352 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:40.126323 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4125f746-f9c7-4437-9a97-a7ce6db73e45" path="/var/lib/kubelet/pods/4125f746-f9c7-4437-9a97-a7ce6db73e45/volumes" Jul 21 02:16:40.937662 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:40.937629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:41.038519 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:41.038478 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:43.505673 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.505637 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d7df7c6dc-c2h2s" podUID="2af8b470-f828-4a9a-8475-60a485a43803" containerName="console" containerID="cri-o://27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0" gracePeriod=15 Jul 21 02:16:43.743092 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.743071 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:16:43.855182 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855101 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-console-config\") pod \"2af8b470-f828-4a9a-8475-60a485a43803\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " Jul 21 02:16:43.855182 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855153 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjdx9\" (UniqueName: \"kubernetes.io/projected/2af8b470-f828-4a9a-8475-60a485a43803-kube-api-access-wjdx9\") pod \"2af8b470-f828-4a9a-8475-60a485a43803\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " Jul 21 02:16:43.855182 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855174 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-oauth-serving-cert\") pod \"2af8b470-f828-4a9a-8475-60a485a43803\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " Jul 21 02:16:43.855484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855199 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-oauth-config\") pod \"2af8b470-f828-4a9a-8475-60a485a43803\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " Jul 21 02:16:43.855484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855244 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-trusted-ca-bundle\") pod \"2af8b470-f828-4a9a-8475-60a485a43803\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " Jul 21 02:16:43.855484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855300 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-service-ca\") pod \"2af8b470-f828-4a9a-8475-60a485a43803\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " Jul 21 02:16:43.855484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855333 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-serving-cert\") pod \"2af8b470-f828-4a9a-8475-60a485a43803\" (UID: \"2af8b470-f828-4a9a-8475-60a485a43803\") " Jul 21 02:16:43.855686 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855611 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-console-config" (OuterVolumeSpecName: "console-config") pod "2af8b470-f828-4a9a-8475-60a485a43803" (UID: "2af8b470-f828-4a9a-8475-60a485a43803"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:16:43.855790 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855767 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2af8b470-f828-4a9a-8475-60a485a43803" (UID: "2af8b470-f828-4a9a-8475-60a485a43803"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:16:43.855850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855782 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-service-ca" (OuterVolumeSpecName: "service-ca") pod "2af8b470-f828-4a9a-8475-60a485a43803" (UID: "2af8b470-f828-4a9a-8475-60a485a43803"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:16:43.855850 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.855814 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2af8b470-f828-4a9a-8475-60a485a43803" (UID: "2af8b470-f828-4a9a-8475-60a485a43803"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 02:16:43.857461 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.857440 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2af8b470-f828-4a9a-8475-60a485a43803" (UID: "2af8b470-f828-4a9a-8475-60a485a43803"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:16:43.857540 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.857521 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af8b470-f828-4a9a-8475-60a485a43803-kube-api-access-wjdx9" (OuterVolumeSpecName: "kube-api-access-wjdx9") pod "2af8b470-f828-4a9a-8475-60a485a43803" (UID: "2af8b470-f828-4a9a-8475-60a485a43803"). InnerVolumeSpecName "kube-api-access-wjdx9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:16:43.857606 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.857588 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2af8b470-f828-4a9a-8475-60a485a43803" (UID: "2af8b470-f828-4a9a-8475-60a485a43803"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:16:43.956576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.956541 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-trusted-ca-bundle\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:43.956576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.956573 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-service-ca\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:43.956576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.956582 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-serving-cert\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:43.956756 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.956591 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-console-config\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:43.956756 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.956600 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjdx9\" (UniqueName: \"kubernetes.io/projected/2af8b470-f828-4a9a-8475-60a485a43803-kube-api-access-wjdx9\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:43.956756 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.956609 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af8b470-f828-4a9a-8475-60a485a43803-oauth-serving-cert\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:43.956756 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:43.956616 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af8b470-f828-4a9a-8475-60a485a43803-console-oauth-config\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:16:44.563372 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.563337 2565 generic.go:356] "Generic (PLEG): container finished" podID="2af8b470-f828-4a9a-8475-60a485a43803" containerID="27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0" exitCode=0 Jul 21 02:16:44.563797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.563395 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d7df7c6dc-c2h2s" Jul 21 02:16:44.563797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.563422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7df7c6dc-c2h2s" event={"ID":"2af8b470-f828-4a9a-8475-60a485a43803","Type":"ContainerDied","Data":"27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0"} Jul 21 02:16:44.563797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.563472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d7df7c6dc-c2h2s" event={"ID":"2af8b470-f828-4a9a-8475-60a485a43803","Type":"ContainerDied","Data":"69e01f519570dd29ed184b49cf81da94188456da077fd3a01917c3a835c845ad"} Jul 21 02:16:44.563797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.563498 2565 scope.go:117] "RemoveContainer" containerID="27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0" Jul 21 02:16:44.572127 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.572090 2565 scope.go:117] "RemoveContainer" containerID="27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0" Jul 21 02:16:44.572370 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:16:44.572338 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0\": container with ID starting with 27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0 not found: ID does not exist" containerID="27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0" Jul 21 02:16:44.572481 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.572376 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0"} err="failed to get container status \"27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0\": rpc error: code = NotFound desc = could not find container \"27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0\": container with ID starting with 27fc988a540dce946e122567314d839b389dc1b40ed693f423293bdf3d6213b0 not found: ID does not exist" Jul 21 02:16:44.585520 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.585497 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d7df7c6dc-c2h2s"] Jul 21 02:16:44.591069 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:44.591049 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d7df7c6dc-c2h2s"] Jul 21 02:16:45.730924 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:45.730888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:45.827852 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:45.827821 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:46.126285 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:46.126238 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af8b470-f828-4a9a-8475-60a485a43803" path="/var/lib/kubelet/pods/2af8b470-f828-4a9a-8475-60a485a43803/volumes" Jul 21 02:16:48.176329 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:48.176293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:48.277603 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:48.277578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:53.387121 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:53.387050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:53.493119 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:53.493086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:54.950191 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.950153 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm"] Jul 21 02:16:54.950737 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.950719 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4125f746-f9c7-4437-9a97-a7ce6db73e45" containerName="manager" Jul 21 02:16:54.950789 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.950741 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4125f746-f9c7-4437-9a97-a7ce6db73e45" containerName="manager" Jul 21 02:16:54.950789 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.950782 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af8b470-f828-4a9a-8475-60a485a43803" containerName="console" Jul 21 02:16:54.950856 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.950790 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af8b470-f828-4a9a-8475-60a485a43803" containerName="console" Jul 21 02:16:54.950912 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.950900 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4125f746-f9c7-4437-9a97-a7ce6db73e45" containerName="manager" Jul 21 02:16:54.950957 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.950919 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af8b470-f828-4a9a-8475-60a485a43803" containerName="console" Jul 21 02:16:54.953365 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.953350 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:54.957609 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.957588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wsfwm\"" Jul 21 02:16:54.971982 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:54.971954 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm"] Jul 21 02:16:55.007921 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.007894 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:55.052063 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052034 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-envoy\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052063 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-data\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052307 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052085 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-workload-certs\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052307 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052307 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052224 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-credential-socket\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052307 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052282 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-workload-socket\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052467 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052309 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-token\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052467 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0be838-70cd-4e14-af4a-f65915c2af25-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.052467 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.052408 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dls7s\" (UniqueName: \"kubernetes.io/projected/ca0be838-70cd-4e14-af4a-f65915c2af25-kube-api-access-dls7s\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.153619 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.153579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0be838-70cd-4e14-af4a-f65915c2af25-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.153619 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.153619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dls7s\" (UniqueName: \"kubernetes.io/projected/ca0be838-70cd-4e14-af4a-f65915c2af25-kube-api-access-dls7s\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.153880 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.153733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-envoy\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.153880 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.153768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-data\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.153880 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.153796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-workload-certs\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154026 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.153922 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154026 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-credential-socket\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154137 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154101 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-workload-socket\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154189 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-token\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154246 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-workload-certs\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154246 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154231 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-data\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154353 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154294 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-credential-socket\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154436 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154397 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca0be838-70cd-4e14-af4a-f65915c2af25-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.154514 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.154496 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-workload-socket\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.155971 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.155947 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-envoy\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.156269 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.156240 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-podinfo\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.162536 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.162519 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca0be838-70cd-4e14-af4a-f65915c2af25-istio-token\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.162614 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.162597 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dls7s\" (UniqueName: \"kubernetes.io/projected/ca0be838-70cd-4e14-af4a-f65915c2af25-kube-api-access-dls7s\") pod \"maas-default-gateway-openshift-default-74949dcd89-qbjnm\" (UID: \"ca0be838-70cd-4e14-af4a-f65915c2af25\") " pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.263543 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.263516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:55.286429 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.286398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:55.402736 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.402700 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm"] Jul 21 02:16:55.402933 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:55.402906 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca0be838_70cd_4e14_af4a_f65915c2af25.slice/crio-73ee28c02c471b0fcb5e90abdb74722e7fd309a2d8408401842ecad0fdaeb331 WatchSource:0}: Error finding container 73ee28c02c471b0fcb5e90abdb74722e7fd309a2d8408401842ecad0fdaeb331: Status 404 returned error can't find the container with id 73ee28c02c471b0fcb5e90abdb74722e7fd309a2d8408401842ecad0fdaeb331 Jul 21 02:16:55.404939 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.404911 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:16:55.405002 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.404986 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:16:55.405044 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.405010 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:16:55.624562 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.624459 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" event={"ID":"ca0be838-70cd-4e14-af4a-f65915c2af25","Type":"ContainerStarted","Data":"81a95a772343590036b5b14193aa883fa4b6f3c7015b26f26a3a588743b889eb"} Jul 21 02:16:55.624562 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.624519 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" event={"ID":"ca0be838-70cd-4e14-af4a-f65915c2af25","Type":"ContainerStarted","Data":"73ee28c02c471b0fcb5e90abdb74722e7fd309a2d8408401842ecad0fdaeb331"} Jul 21 02:16:55.649285 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:55.648341 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" podStartSLOduration=1.6483219519999999 podStartE2EDuration="1.648321952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:16:55.646124348 +0000 UTC m=+448.568803514" watchObservedRunningTime="2026-07-21 02:16:55.648321952 +0000 UTC m=+448.571001061" Jul 21 02:16:56.264469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:56.264423 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:56.270553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:56.270524 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:56.629973 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:56.629880 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:56.630824 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:56.630804 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:16:56.661550 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:56.661516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:56.731657 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:56.731629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:56.787559 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:56.787526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:57.463992 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.463958 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9fzwg"] Jul 21 02:16:57.466507 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.466491 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fzwg" Jul 21 02:16:57.470032 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.470010 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9cx4b\"" Jul 21 02:16:57.476314 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.476293 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fzwg"] Jul 21 02:16:57.496053 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.496022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:57.576077 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.576034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:16:57.578211 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.578191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ptc\" (UniqueName: \"kubernetes.io/projected/892612ce-4cc5-4eba-bbee-1299b855fd34-kube-api-access-r4ptc\") pod \"authorino-58cd955675-9fzwg\" (UID: \"892612ce-4cc5-4eba-bbee-1299b855fd34\") " pod="kuadrant-system/authorino-58cd955675-9fzwg" Jul 21 02:16:57.604849 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.604818 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bpcss"] Jul 21 02:16:57.607364 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.607339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bpcss" Jul 21 02:16:57.615610 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.615591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bpcss"] Jul 21 02:16:57.679302 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.679249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bvkq\" (UniqueName: \"kubernetes.io/projected/01373171-b5d2-4488-9cd5-d0b520272a60-kube-api-access-9bvkq\") pod \"authorino-75d556bd77-bpcss\" (UID: \"01373171-b5d2-4488-9cd5-d0b520272a60\") " pod="kuadrant-system/authorino-75d556bd77-bpcss" Jul 21 02:16:57.679470 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.679389 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ptc\" (UniqueName: \"kubernetes.io/projected/892612ce-4cc5-4eba-bbee-1299b855fd34-kube-api-access-r4ptc\") pod \"authorino-58cd955675-9fzwg\" (UID: \"892612ce-4cc5-4eba-bbee-1299b855fd34\") " pod="kuadrant-system/authorino-58cd955675-9fzwg" Jul 21 02:16:57.688507 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.688474 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ptc\" (UniqueName: \"kubernetes.io/projected/892612ce-4cc5-4eba-bbee-1299b855fd34-kube-api-access-r4ptc\") pod \"authorino-58cd955675-9fzwg\" (UID: \"892612ce-4cc5-4eba-bbee-1299b855fd34\") " pod="kuadrant-system/authorino-58cd955675-9fzwg" Jul 21 02:16:57.777114 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.777084 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fzwg" Jul 21 02:16:57.780546 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.780529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bvkq\" (UniqueName: \"kubernetes.io/projected/01373171-b5d2-4488-9cd5-d0b520272a60-kube-api-access-9bvkq\") pod \"authorino-75d556bd77-bpcss\" (UID: \"01373171-b5d2-4488-9cd5-d0b520272a60\") " pod="kuadrant-system/authorino-75d556bd77-bpcss" Jul 21 02:16:57.789506 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.789474 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bvkq\" (UniqueName: \"kubernetes.io/projected/01373171-b5d2-4488-9cd5-d0b520272a60-kube-api-access-9bvkq\") pod \"authorino-75d556bd77-bpcss\" (UID: \"01373171-b5d2-4488-9cd5-d0b520272a60\") " pod="kuadrant-system/authorino-75d556bd77-bpcss" Jul 21 02:16:57.903700 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.903670 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fzwg"] Jul 21 02:16:57.906784 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:57.906758 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod892612ce_4cc5_4eba_bbee_1299b855fd34.slice/crio-0a4b49ce324b82e99c87adf61bf4008de0f30a6f99dbdf38e1dc2a4cda0c5d8a WatchSource:0}: Error finding container 0a4b49ce324b82e99c87adf61bf4008de0f30a6f99dbdf38e1dc2a4cda0c5d8a: Status 404 returned error can't find the container with id 0a4b49ce324b82e99c87adf61bf4008de0f30a6f99dbdf38e1dc2a4cda0c5d8a Jul 21 02:16:57.916808 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:57.916787 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bpcss" Jul 21 02:16:58.047645 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:58.047616 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bpcss"] Jul 21 02:16:58.049128 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:16:58.049097 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01373171_b5d2_4488_9cd5_d0b520272a60.slice/crio-973ea0cb61b0663fa45016158a6335572eed2cc644f9f5b3ec4dec5f02f6e7e9 WatchSource:0}: Error finding container 973ea0cb61b0663fa45016158a6335572eed2cc644f9f5b3ec4dec5f02f6e7e9: Status 404 returned error can't find the container with id 973ea0cb61b0663fa45016158a6335572eed2cc644f9f5b3ec4dec5f02f6e7e9 Jul 21 02:16:58.649159 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:58.649083 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fzwg" event={"ID":"892612ce-4cc5-4eba-bbee-1299b855fd34","Type":"ContainerStarted","Data":"0a4b49ce324b82e99c87adf61bf4008de0f30a6f99dbdf38e1dc2a4cda0c5d8a"} Jul 21 02:16:58.651768 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:16:58.651687 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bpcss" event={"ID":"01373171-b5d2-4488-9cd5-d0b520272a60","Type":"ContainerStarted","Data":"973ea0cb61b0663fa45016158a6335572eed2cc644f9f5b3ec4dec5f02f6e7e9"} Jul 21 02:17:01.671576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:01.671482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fzwg" event={"ID":"892612ce-4cc5-4eba-bbee-1299b855fd34","Type":"ContainerStarted","Data":"0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e"} Jul 21 02:17:01.672964 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:01.672940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bpcss" event={"ID":"01373171-b5d2-4488-9cd5-d0b520272a60","Type":"ContainerStarted","Data":"b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43"} Jul 21 02:17:01.688839 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:01.688793 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9fzwg" podStartSLOduration=1.233656556 podStartE2EDuration="4.688778932s" totalImagesPullingTime="3.455122376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:17:01.686535461 +0000 UTC m=+454.609214569" watchObservedRunningTime="2026-07-21 02:17:01.688778932 +0000 UTC m=+454.611458038" Jul 21 02:17:01.704667 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:01.704626 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bpcss" podStartSLOduration=1.3802434749999999 podStartE2EDuration="4.70461166s" totalImagesPullingTime="3.324368185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:17:01.703443368 +0000 UTC m=+454.626122493" watchObservedRunningTime="2026-07-21 02:17:01.70461166 +0000 UTC m=+454.627290766" Jul 21 02:17:01.753982 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:01.753952 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fzwg"] Jul 21 02:17:02.989578 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:02.989550 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:03.683907 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:03.683870 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9fzwg" podUID="892612ce-4cc5-4eba-bbee-1299b855fd34" containerName="authorino" containerID="cri-o://0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e" gracePeriod=30 Jul 21 02:17:03.929033 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:03.929009 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fzwg" Jul 21 02:17:04.039487 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.039451 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4ptc\" (UniqueName: \"kubernetes.io/projected/892612ce-4cc5-4eba-bbee-1299b855fd34-kube-api-access-r4ptc\") pod \"892612ce-4cc5-4eba-bbee-1299b855fd34\" (UID: \"892612ce-4cc5-4eba-bbee-1299b855fd34\") " Jul 21 02:17:04.041484 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.041463 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/892612ce-4cc5-4eba-bbee-1299b855fd34-kube-api-access-r4ptc" (OuterVolumeSpecName: "kube-api-access-r4ptc") pod "892612ce-4cc5-4eba-bbee-1299b855fd34" (UID: "892612ce-4cc5-4eba-bbee-1299b855fd34"). InnerVolumeSpecName "kube-api-access-r4ptc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:17:04.140754 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.140730 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4ptc\" (UniqueName: \"kubernetes.io/projected/892612ce-4cc5-4eba-bbee-1299b855fd34-kube-api-access-r4ptc\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:17:04.690630 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.690599 2565 generic.go:356] "Generic (PLEG): container finished" podID="892612ce-4cc5-4eba-bbee-1299b855fd34" containerID="0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e" exitCode=0 Jul 21 02:17:04.690801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.690643 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9fzwg" Jul 21 02:17:04.690801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.690684 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fzwg" event={"ID":"892612ce-4cc5-4eba-bbee-1299b855fd34","Type":"ContainerDied","Data":"0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e"} Jul 21 02:17:04.690801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.690730 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9fzwg" event={"ID":"892612ce-4cc5-4eba-bbee-1299b855fd34","Type":"ContainerDied","Data":"0a4b49ce324b82e99c87adf61bf4008de0f30a6f99dbdf38e1dc2a4cda0c5d8a"} Jul 21 02:17:04.690801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.690752 2565 scope.go:117] "RemoveContainer" containerID="0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e" Jul 21 02:17:04.701722 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.701706 2565 scope.go:117] "RemoveContainer" containerID="0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e" Jul 21 02:17:04.701994 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:17:04.701975 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e\": container with ID starting with 0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e not found: ID does not exist" containerID="0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e" Jul 21 02:17:04.702048 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.702003 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e"} err="failed to get container status \"0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e\": rpc error: code = NotFound desc = could not find container \"0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e\": container with ID starting with 0bc6ea9e11b4188b50c8daf6950623bbad64c897fb0b83747c0f361bc22f3e6e not found: ID does not exist" Jul 21 02:17:04.723717 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.723687 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fzwg"] Jul 21 02:17:04.731304 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:04.730461 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9fzwg"] Jul 21 02:17:06.126361 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:06.126329 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="892612ce-4cc5-4eba-bbee-1299b855fd34" path="/var/lib/kubelet/pods/892612ce-4cc5-4eba-bbee-1299b855fd34/volumes" Jul 21 02:17:17.856796 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:17.856768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:17.957697 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:17.957660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:18.370314 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:18.370249 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:32.192282 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.192238 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:32.448373 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.448289 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xrhq2"] Jul 21 02:17:32.448715 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.448700 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="892612ce-4cc5-4eba-bbee-1299b855fd34" containerName="authorino" Jul 21 02:17:32.448762 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.448717 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="892612ce-4cc5-4eba-bbee-1299b855fd34" containerName="authorino" Jul 21 02:17:32.448805 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.448784 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="892612ce-4cc5-4eba-bbee-1299b855fd34" containerName="authorino" Jul 21 02:17:32.454833 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.454813 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" Jul 21 02:17:32.482072 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.482038 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xrhq2"] Jul 21 02:17:32.488675 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.488651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6kf\" (UniqueName: \"kubernetes.io/projected/2b276c63-f958-402c-96df-96db6d3eda99-kube-api-access-ml6kf\") pod \"authorino-5d4b67c446-xrhq2\" (UID: \"2b276c63-f958-402c-96df-96db6d3eda99\") " pod="kuadrant-system/authorino-5d4b67c446-xrhq2" Jul 21 02:17:32.590122 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.590086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6kf\" (UniqueName: \"kubernetes.io/projected/2b276c63-f958-402c-96df-96db6d3eda99-kube-api-access-ml6kf\") pod \"authorino-5d4b67c446-xrhq2\" (UID: \"2b276c63-f958-402c-96df-96db6d3eda99\") " pod="kuadrant-system/authorino-5d4b67c446-xrhq2" Jul 21 02:17:32.601120 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.601090 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6kf\" (UniqueName: \"kubernetes.io/projected/2b276c63-f958-402c-96df-96db6d3eda99-kube-api-access-ml6kf\") pod \"authorino-5d4b67c446-xrhq2\" (UID: \"2b276c63-f958-402c-96df-96db6d3eda99\") " pod="kuadrant-system/authorino-5d4b67c446-xrhq2" Jul 21 02:17:32.658915 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.658880 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xrhq2"] Jul 21 02:17:32.659163 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.659151 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" Jul 21 02:17:32.694011 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.693981 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:32.790134 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.790113 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xrhq2"] Jul 21 02:17:32.791863 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:17:32.791839 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b276c63_f958_402c_96df_96db6d3eda99.slice/crio-0d7e0ed3bd0addc2e71a756523302305c08597b00040bcf88add6a9ac2b055b2 WatchSource:0}: Error finding container 0d7e0ed3bd0addc2e71a756523302305c08597b00040bcf88add6a9ac2b055b2: Status 404 returned error can't find the container with id 0d7e0ed3bd0addc2e71a756523302305c08597b00040bcf88add6a9ac2b055b2 Jul 21 02:17:32.841320 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.841285 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" event={"ID":"2b276c63-f958-402c-96df-96db6d3eda99","Type":"ContainerStarted","Data":"0d7e0ed3bd0addc2e71a756523302305c08597b00040bcf88add6a9ac2b055b2"} Jul 21 02:17:32.986123 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.986034 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-695f675644-sm5ds"] Jul 21 02:17:32.991002 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.990977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:32.994310 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:32.994287 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 21 02:17:33.002777 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.002754 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-695f675644-sm5ds"] Jul 21 02:17:33.093730 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.093697 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vfmh\" (UniqueName: \"kubernetes.io/projected/85895277-c10e-4db2-ac45-2a21be115b59-kube-api-access-4vfmh\") pod \"authorino-695f675644-sm5ds\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:33.093889 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.093809 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85895277-c10e-4db2-ac45-2a21be115b59-tls-cert\") pod \"authorino-695f675644-sm5ds\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:33.194731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.194386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vfmh\" (UniqueName: \"kubernetes.io/projected/85895277-c10e-4db2-ac45-2a21be115b59-kube-api-access-4vfmh\") pod \"authorino-695f675644-sm5ds\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:33.194731 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.194539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85895277-c10e-4db2-ac45-2a21be115b59-tls-cert\") pod \"authorino-695f675644-sm5ds\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:33.197352 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.197326 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85895277-c10e-4db2-ac45-2a21be115b59-tls-cert\") pod \"authorino-695f675644-sm5ds\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:33.204679 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.204658 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vfmh\" (UniqueName: \"kubernetes.io/projected/85895277-c10e-4db2-ac45-2a21be115b59-kube-api-access-4vfmh\") pod \"authorino-695f675644-sm5ds\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:33.300977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.300944 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:17:33.435249 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.435221 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-695f675644-sm5ds"] Jul 21 02:17:33.435696 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:17:33.435666 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85895277_c10e_4db2_ac45_2a21be115b59.slice/crio-2e48fd80bdd426066d57ea779049cfcd51bad627e4c0425261974f027d085b71 WatchSource:0}: Error finding container 2e48fd80bdd426066d57ea779049cfcd51bad627e4c0425261974f027d085b71: Status 404 returned error can't find the container with id 2e48fd80bdd426066d57ea779049cfcd51bad627e4c0425261974f027d085b71 Jul 21 02:17:33.850653 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.850622 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" event={"ID":"2b276c63-f958-402c-96df-96db6d3eda99","Type":"ContainerStarted","Data":"fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1"} Jul 21 02:17:33.850784 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.850658 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" podUID="2b276c63-f958-402c-96df-96db6d3eda99" containerName="authorino" containerID="cri-o://fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1" gracePeriod=30 Jul 21 02:17:33.852009 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.851979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695f675644-sm5ds" event={"ID":"85895277-c10e-4db2-ac45-2a21be115b59","Type":"ContainerStarted","Data":"2e48fd80bdd426066d57ea779049cfcd51bad627e4c0425261974f027d085b71"} Jul 21 02:17:33.872779 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:33.872736 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" podStartSLOduration=1.563554823 podStartE2EDuration="1.872720077s" totalImagesPullingTime="309.165254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:17:33.870913814 +0000 UTC m=+486.793592937" watchObservedRunningTime="2026-07-21 02:17:33.872720077 +0000 UTC m=+486.795399184" Jul 21 02:17:34.095236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.095212 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" Jul 21 02:17:34.203517 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.203481 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml6kf\" (UniqueName: \"kubernetes.io/projected/2b276c63-f958-402c-96df-96db6d3eda99-kube-api-access-ml6kf\") pod \"2b276c63-f958-402c-96df-96db6d3eda99\" (UID: \"2b276c63-f958-402c-96df-96db6d3eda99\") " Jul 21 02:17:34.205531 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.205509 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b276c63-f958-402c-96df-96db6d3eda99-kube-api-access-ml6kf" (OuterVolumeSpecName: "kube-api-access-ml6kf") pod "2b276c63-f958-402c-96df-96db6d3eda99" (UID: "2b276c63-f958-402c-96df-96db6d3eda99"). InnerVolumeSpecName "kube-api-access-ml6kf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:17:34.304544 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.304512 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml6kf\" (UniqueName: \"kubernetes.io/projected/2b276c63-f958-402c-96df-96db6d3eda99-kube-api-access-ml6kf\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:17:34.858918 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.858813 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695f675644-sm5ds" event={"ID":"85895277-c10e-4db2-ac45-2a21be115b59","Type":"ContainerStarted","Data":"6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61"} Jul 21 02:17:34.859942 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.859921 2565 generic.go:356] "Generic (PLEG): container finished" podID="2b276c63-f958-402c-96df-96db6d3eda99" containerID="fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1" exitCode=0 Jul 21 02:17:34.860044 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.859956 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" Jul 21 02:17:34.860044 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.859972 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" event={"ID":"2b276c63-f958-402c-96df-96db6d3eda99","Type":"ContainerDied","Data":"fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1"} Jul 21 02:17:34.860044 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.859997 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xrhq2" event={"ID":"2b276c63-f958-402c-96df-96db6d3eda99","Type":"ContainerDied","Data":"0d7e0ed3bd0addc2e71a756523302305c08597b00040bcf88add6a9ac2b055b2"} Jul 21 02:17:34.860044 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.860013 2565 scope.go:117] "RemoveContainer" containerID="fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1" Jul 21 02:17:34.868712 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.868697 2565 scope.go:117] "RemoveContainer" containerID="fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1" Jul 21 02:17:34.868963 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:17:34.868941 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1\": container with ID starting with fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1 not found: ID does not exist" containerID="fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1" Jul 21 02:17:34.869022 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.868970 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1"} err="failed to get container status \"fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1\": rpc error: code = NotFound desc = could not find container \"fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1\": container with ID starting with fabc692bf3a052d22e8342a61d813bc41e2d2e9cc271c7acad18c9085f9581f1 not found: ID does not exist" Jul 21 02:17:34.881468 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.881432 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-695f675644-sm5ds" podStartSLOduration=2.489473612 podStartE2EDuration="2.8814182s" totalImagesPullingTime="391.944588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:17:34.876970578 +0000 UTC m=+487.799649688" watchObservedRunningTime="2026-07-21 02:17:34.8814182 +0000 UTC m=+487.804097307" Jul 21 02:17:34.901549 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.901512 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xrhq2"] Jul 21 02:17:34.914195 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.914164 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xrhq2"] Jul 21 02:17:34.926698 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.926670 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bpcss"] Jul 21 02:17:34.926876 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:34.926852 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bpcss" podUID="01373171-b5d2-4488-9cd5-d0b520272a60" containerName="authorino" containerID="cri-o://b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43" gracePeriod=30 Jul 21 02:17:35.185998 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.185973 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bpcss" Jul 21 02:17:35.313843 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.313808 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bvkq\" (UniqueName: \"kubernetes.io/projected/01373171-b5d2-4488-9cd5-d0b520272a60-kube-api-access-9bvkq\") pod \"01373171-b5d2-4488-9cd5-d0b520272a60\" (UID: \"01373171-b5d2-4488-9cd5-d0b520272a60\") " Jul 21 02:17:35.315853 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.315831 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01373171-b5d2-4488-9cd5-d0b520272a60-kube-api-access-9bvkq" (OuterVolumeSpecName: "kube-api-access-9bvkq") pod "01373171-b5d2-4488-9cd5-d0b520272a60" (UID: "01373171-b5d2-4488-9cd5-d0b520272a60"). InnerVolumeSpecName "kube-api-access-9bvkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:17:35.414866 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.414830 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bvkq\" (UniqueName: \"kubernetes.io/projected/01373171-b5d2-4488-9cd5-d0b520272a60-kube-api-access-9bvkq\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:17:35.867396 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.867361 2565 generic.go:356] "Generic (PLEG): container finished" podID="01373171-b5d2-4488-9cd5-d0b520272a60" containerID="b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43" exitCode=0 Jul 21 02:17:35.867619 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.867403 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bpcss" Jul 21 02:17:35.867619 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.867440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bpcss" event={"ID":"01373171-b5d2-4488-9cd5-d0b520272a60","Type":"ContainerDied","Data":"b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43"} Jul 21 02:17:35.867619 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.867480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bpcss" event={"ID":"01373171-b5d2-4488-9cd5-d0b520272a60","Type":"ContainerDied","Data":"973ea0cb61b0663fa45016158a6335572eed2cc644f9f5b3ec4dec5f02f6e7e9"} Jul 21 02:17:35.867619 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.867506 2565 scope.go:117] "RemoveContainer" containerID="b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43" Jul 21 02:17:35.876651 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.876635 2565 scope.go:117] "RemoveContainer" containerID="b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43" Jul 21 02:17:35.876927 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:17:35.876901 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43\": container with ID starting with b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43 not found: ID does not exist" containerID="b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43" Jul 21 02:17:35.876996 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.876928 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43"} err="failed to get container status \"b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43\": rpc error: code = NotFound desc = could not find container \"b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43\": container with ID starting with b79e52785c80334e8eab202d5cffebc6d79954f1664ba9932102818975737d43 not found: ID does not exist" Jul 21 02:17:35.913834 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.913802 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bpcss"] Jul 21 02:17:35.916609 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:35.916584 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bpcss"] Jul 21 02:17:36.126360 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:36.126286 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01373171-b5d2-4488-9cd5-d0b520272a60" path="/var/lib/kubelet/pods/01373171-b5d2-4488-9cd5-d0b520272a60/volumes" Jul 21 02:17:36.126612 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:36.126599 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b276c63-f958-402c-96df-96db6d3eda99" path="/var/lib/kubelet/pods/2b276c63-f958-402c-96df-96db6d3eda99/volumes" Jul 21 02:17:40.225452 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:40.225417 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:40.409330 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:40.409250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:40.493388 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:40.493250 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:43.492666 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:43.492635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:17:43.602140 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:17:43.602100 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:09.062670 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:09.062635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:09.159225 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:09.159195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:10.904797 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:10.904759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:11.006144 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:11.006112 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:15.220870 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:15.220842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:15.321419 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:15.321382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:15.763509 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:15.763481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:16.234346 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:16.234220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:16.736814 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:16.736782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:16.835611 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:16.835581 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:25.134755 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:25.134723 2565 generic.go:356] "Generic (PLEG): container finished" podID="ca0be838-70cd-4e14-af4a-f65915c2af25" containerID="81a95a772343590036b5b14193aa883fa4b6f3c7015b26f26a3a588743b889eb" exitCode=0 Jul 21 02:18:25.135172 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:25.134793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" event={"ID":"ca0be838-70cd-4e14-af4a-f65915c2af25","Type":"ContainerDied","Data":"81a95a772343590036b5b14193aa883fa4b6f3c7015b26f26a3a588743b889eb"} Jul 21 02:18:25.135172 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:25.135122 2565 scope.go:117] "RemoveContainer" containerID="81a95a772343590036b5b14193aa883fa4b6f3c7015b26f26a3a588743b889eb" Jul 21 02:18:25.136040 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:25.136014 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:18:25.136106 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:25.136076 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:18:25.136141 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:25.136108 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 02:18:26.145726 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:26.145678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" event={"ID":"ca0be838-70cd-4e14-af4a-f65915c2af25","Type":"ContainerStarted","Data":"0da86dea2fced247349ee35da42b4e17b43db1a9f1e3cf507b256243dee8ab71"} Jul 21 02:18:26.264813 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:26.264771 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:18:26.265874 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:26.265835 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-74949dcd89-qbjnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 02:18:26.266004 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:26.265899 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" podUID="ca0be838-70cd-4e14-af4a-f65915c2af25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 02:18:26.630870 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:26.630833 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:18:26.787019 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:26.786978 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:26.884699 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:26.884608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:27.264523 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:27.264491 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-74949dcd89-qbjnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 02:18:27.265077 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:27.265046 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" podUID="ca0be838-70cd-4e14-af4a-f65915c2af25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 02:18:28.264861 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:28.264822 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-74949dcd89-qbjnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 02:18:28.265351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:28.264903 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" podUID="ca0be838-70cd-4e14-af4a-f65915c2af25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 02:18:29.263855 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:29.263824 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-74949dcd89-qbjnm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 02:18:29.264028 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:29.263878 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" podUID="ca0be838-70cd-4e14-af4a-f65915c2af25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 02:18:30.268067 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:30.268038 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:18:30.268967 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:30.268953 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-74949dcd89-qbjnm" Jul 21 02:18:36.609089 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:36.609058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:43.724325 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:43.724283 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:56.783529 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.783496 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh"] Jul 21 02:18:56.783901 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.783888 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01373171-b5d2-4488-9cd5-d0b520272a60" containerName="authorino" Jul 21 02:18:56.783949 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.783903 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="01373171-b5d2-4488-9cd5-d0b520272a60" containerName="authorino" Jul 21 02:18:56.783949 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.783913 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b276c63-f958-402c-96df-96db6d3eda99" containerName="authorino" Jul 21 02:18:56.783949 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.783918 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b276c63-f958-402c-96df-96db6d3eda99" containerName="authorino" Jul 21 02:18:56.784039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.783984 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b276c63-f958-402c-96df-96db6d3eda99" containerName="authorino" Jul 21 02:18:56.784039 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.783992 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="01373171-b5d2-4488-9cd5-d0b520272a60" containerName="authorino" Jul 21 02:18:56.785919 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.785904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.790779 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.790755 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 02:18:56.790918 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.790756 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-64ltv\"" Jul 21 02:18:56.790918 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.790756 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 21 02:18:56.791046 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.790972 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 02:18:56.796970 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.796949 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh"] Jul 21 02:18:56.815499 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.815475 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:18:56.847075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.847048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.847184 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.847091 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.847184 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.847146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.847299 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.847184 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.847299 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.847245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7km5\" (UniqueName: \"kubernetes.io/projected/31ffb766-1e9d-429e-91c9-80d6fe940a82-kube-api-access-d7km5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.847391 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.847306 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ffb766-1e9d-429e-91c9-80d6fe940a82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.948001 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.947965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.948188 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.948025 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.948188 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.948075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.948188 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.948108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7km5\" (UniqueName: \"kubernetes.io/projected/31ffb766-1e9d-429e-91c9-80d6fe940a82-kube-api-access-d7km5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.948188 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.948160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ffb766-1e9d-429e-91c9-80d6fe940a82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.948569 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.948220 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.948719 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.948697 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.949173 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.949149 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.949830 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.949802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.951317 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.951297 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31ffb766-1e9d-429e-91c9-80d6fe940a82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.952035 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.952016 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31ffb766-1e9d-429e-91c9-80d6fe940a82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:56.958043 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:56.958020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7km5\" (UniqueName: \"kubernetes.io/projected/31ffb766-1e9d-429e-91c9-80d6fe940a82-kube-api-access-d7km5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-ljgfh\" (UID: \"31ffb766-1e9d-429e-91c9-80d6fe940a82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:57.096912 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:57.096836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:18:57.227621 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:57.227591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh"] Jul 21 02:18:57.228738 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:18:57.228716 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ffb766_1e9d_429e_91c9_80d6fe940a82.slice/crio-b1170d080049e482f3dbe07ffa86f2c2aed3a1dd1019e33e2a01b4339fd8b9b1 WatchSource:0}: Error finding container b1170d080049e482f3dbe07ffa86f2c2aed3a1dd1019e33e2a01b4339fd8b9b1: Status 404 returned error can't find the container with id b1170d080049e482f3dbe07ffa86f2c2aed3a1dd1019e33e2a01b4339fd8b9b1 Jul 21 02:18:57.328114 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:57.328084 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" event={"ID":"31ffb766-1e9d-429e-91c9-80d6fe940a82","Type":"ContainerStarted","Data":"b1170d080049e482f3dbe07ffa86f2c2aed3a1dd1019e33e2a01b4339fd8b9b1"} Jul 21 02:18:59.340873 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:59.340836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" event={"ID":"31ffb766-1e9d-429e-91c9-80d6fe940a82","Type":"ContainerStarted","Data":"a65c9f879bb6e10633d06b8493286e3bc3f8fa08813a0776de01c9d69998e7df"} Jul 21 02:18:59.363129 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:18:59.363073 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" podStartSLOduration=2.284986904 podStartE2EDuration="3.363058879s" totalImagesPullingTime="1.078071975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:18:59.361335395 +0000 UTC m=+572.284014521" watchObservedRunningTime="2026-07-21 02:18:59.363058879 +0000 UTC m=+572.285737985" Jul 21 02:19:04.307577 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:04.307534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:19:07.097679 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:07.097648 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:19:07.098178 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:07.097735 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:19:07.109810 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:07.109784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:19:07.396397 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:07.396321 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-ljgfh" Jul 21 02:19:08.290622 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.290592 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc"] Jul 21 02:19:08.293369 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.293347 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.296333 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.296316 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 21 02:19:08.306953 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.306934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc"] Jul 21 02:19:08.317771 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.317751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:19:08.348572 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.348552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsvfp\" (UniqueName: \"kubernetes.io/projected/908ceb08-0116-415a-b189-34c96f5cef7e-kube-api-access-hsvfp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.348673 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.348584 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.348673 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.348625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.348756 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.348695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.348800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.348751 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.348800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.348780 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908ceb08-0116-415a-b189-34c96f5cef7e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449320 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449350 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908ceb08-0116-415a-b189-34c96f5cef7e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449469 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449438 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsvfp\" (UniqueName: \"kubernetes.io/projected/908ceb08-0116-415a-b189-34c96f5cef7e-kube-api-access-hsvfp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449667 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449779 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449758 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449893 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.449949 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.449934 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.451596 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.451580 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/908ceb08-0116-415a-b189-34c96f5cef7e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.452058 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.452040 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/908ceb08-0116-415a-b189-34c96f5cef7e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.462523 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.462502 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsvfp\" (UniqueName: \"kubernetes.io/projected/908ceb08-0116-415a-b189-34c96f5cef7e-kube-api-access-hsvfp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc\" (UID: \"908ceb08-0116-415a-b189-34c96f5cef7e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.602616 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.602551 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:08.734467 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:08.734443 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc"] Jul 21 02:19:08.736083 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:19:08.736054 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908ceb08_0116_415a_b189_34c96f5cef7e.slice/crio-7d23ec4dabcf1cce40bfc7497c505c9b8ca09ff06f78c07a17abf27efd512cce WatchSource:0}: Error finding container 7d23ec4dabcf1cce40bfc7497c505c9b8ca09ff06f78c07a17abf27efd512cce: Status 404 returned error can't find the container with id 7d23ec4dabcf1cce40bfc7497c505c9b8ca09ff06f78c07a17abf27efd512cce Jul 21 02:19:09.397721 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:09.397685 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" event={"ID":"908ceb08-0116-415a-b189-34c96f5cef7e","Type":"ContainerStarted","Data":"8e8720241fdd22b7d55ea3ef4fe7577374ab11d964c9e93ebd33c8f2d08ba489"} Jul 21 02:19:09.398155 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:09.397734 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" event={"ID":"908ceb08-0116-415a-b189-34c96f5cef7e","Type":"ContainerStarted","Data":"7d23ec4dabcf1cce40bfc7497c505c9b8ca09ff06f78c07a17abf27efd512cce"} Jul 21 02:19:09.418553 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:09.418515 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" podStartSLOduration=1.237603665 podStartE2EDuration="1.418501609s" totalImagesPullingTime="180.897944ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:19:09.415086579 +0000 UTC m=+582.337765712" watchObservedRunningTime="2026-07-21 02:19:09.418501609 +0000 UTC m=+582.341180728" Jul 21 02:19:15.623030 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:15.622997 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:19:18.603131 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:18.603088 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:18.603544 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:18.603182 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:18.615875 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:18.615850 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:19.475104 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:19.475075 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc" Jul 21 02:19:28.032459 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:28.032434 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:19:28.033227 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:28.033208 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:19:30.874169 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:30.874132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:19:31.036876 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:19:31.036841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:20:23.436642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:23.436608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:20:24.665957 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:24.665922 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:20:39.642563 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.642526 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9697689-f89w8"] Jul 21 02:20:39.646032 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.646013 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:39.657075 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.657054 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9697689-f89w8"] Jul 21 02:20:39.822292 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.822240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnwrh\" (UniqueName: \"kubernetes.io/projected/5a9563cb-1b4e-43c0-a688-4782fca81a6c-kube-api-access-nnwrh\") pod \"authorino-9697689-f89w8\" (UID: \"5a9563cb-1b4e-43c0-a688-4782fca81a6c\") " pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:39.822418 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.822307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a9563cb-1b4e-43c0-a688-4782fca81a6c-tls-cert\") pod \"authorino-9697689-f89w8\" (UID: \"5a9563cb-1b4e-43c0-a688-4782fca81a6c\") " pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:39.923616 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.923556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwrh\" (UniqueName: \"kubernetes.io/projected/5a9563cb-1b4e-43c0-a688-4782fca81a6c-kube-api-access-nnwrh\") pod \"authorino-9697689-f89w8\" (UID: \"5a9563cb-1b4e-43c0-a688-4782fca81a6c\") " pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:39.923616 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.923596 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a9563cb-1b4e-43c0-a688-4782fca81a6c-tls-cert\") pod \"authorino-9697689-f89w8\" (UID: \"5a9563cb-1b4e-43c0-a688-4782fca81a6c\") " pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:39.925821 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.925797 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5a9563cb-1b4e-43c0-a688-4782fca81a6c-tls-cert\") pod \"authorino-9697689-f89w8\" (UID: \"5a9563cb-1b4e-43c0-a688-4782fca81a6c\") " pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:39.932181 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.932157 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnwrh\" (UniqueName: \"kubernetes.io/projected/5a9563cb-1b4e-43c0-a688-4782fca81a6c-kube-api-access-nnwrh\") pod \"authorino-9697689-f89w8\" (UID: \"5a9563cb-1b4e-43c0-a688-4782fca81a6c\") " pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:39.955304 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:39.955285 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9697689-f89w8" Jul 21 02:20:40.088236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:40.088209 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9697689-f89w8"] Jul 21 02:20:40.089754 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:20:40.089726 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a9563cb_1b4e_43c0_a688_4782fca81a6c.slice/crio-c0c5beef1436ec997d7bd3e0e1dff23d9903e721eab119dbcc32fdd256f3574e WatchSource:0}: Error finding container c0c5beef1436ec997d7bd3e0e1dff23d9903e721eab119dbcc32fdd256f3574e: Status 404 returned error can't find the container with id c0c5beef1436ec997d7bd3e0e1dff23d9903e721eab119dbcc32fdd256f3574e Jul 21 02:20:40.091498 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:40.091474 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 02:20:40.905160 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:40.905127 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9697689-f89w8" event={"ID":"5a9563cb-1b4e-43c0-a688-4782fca81a6c","Type":"ContainerStarted","Data":"41765c208b3bf5d1fdad840b3fd4bd64caff6716e978913c46463b0763c6865a"} Jul 21 02:20:40.905160 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:40.905175 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9697689-f89w8" event={"ID":"5a9563cb-1b4e-43c0-a688-4782fca81a6c","Type":"ContainerStarted","Data":"c0c5beef1436ec997d7bd3e0e1dff23d9903e721eab119dbcc32fdd256f3574e"} Jul 21 02:20:40.934765 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:40.934708 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9697689-f89w8" podStartSLOduration=1.531993862 podStartE2EDuration="1.934675008s" totalImagesPullingTime="402.681146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:20:40.932467188 +0000 UTC m=+673.855146295" watchObservedRunningTime="2026-07-21 02:20:40.934675008 +0000 UTC m=+673.857354117" Jul 21 02:20:40.970633 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:40.970583 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-695f675644-sm5ds"] Jul 21 02:20:40.971376 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:40.971341 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-695f675644-sm5ds" podUID="85895277-c10e-4db2-ac45-2a21be115b59" containerName="authorino" containerID="cri-o://6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61" gracePeriod=30 Jul 21 02:20:41.243269 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.243232 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:20:41.336303 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.336251 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vfmh\" (UniqueName: \"kubernetes.io/projected/85895277-c10e-4db2-ac45-2a21be115b59-kube-api-access-4vfmh\") pod \"85895277-c10e-4db2-ac45-2a21be115b59\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " Jul 21 02:20:41.336483 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.336314 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85895277-c10e-4db2-ac45-2a21be115b59-tls-cert\") pod \"85895277-c10e-4db2-ac45-2a21be115b59\" (UID: \"85895277-c10e-4db2-ac45-2a21be115b59\") " Jul 21 02:20:41.338375 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.338342 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85895277-c10e-4db2-ac45-2a21be115b59-kube-api-access-4vfmh" (OuterVolumeSpecName: "kube-api-access-4vfmh") pod "85895277-c10e-4db2-ac45-2a21be115b59" (UID: "85895277-c10e-4db2-ac45-2a21be115b59"). InnerVolumeSpecName "kube-api-access-4vfmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:20:41.347930 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.347903 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85895277-c10e-4db2-ac45-2a21be115b59-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "85895277-c10e-4db2-ac45-2a21be115b59" (UID: "85895277-c10e-4db2-ac45-2a21be115b59"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:20:41.437785 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.437712 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vfmh\" (UniqueName: \"kubernetes.io/projected/85895277-c10e-4db2-ac45-2a21be115b59-kube-api-access-4vfmh\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:20:41.437785 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.437741 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/85895277-c10e-4db2-ac45-2a21be115b59-tls-cert\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:20:41.486764 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.486735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:20:41.577726 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.577689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:20:41.912177 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.912139 2565 generic.go:356] "Generic (PLEG): container finished" podID="85895277-c10e-4db2-ac45-2a21be115b59" containerID="6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61" exitCode=0 Jul 21 02:20:41.912752 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.912204 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-695f675644-sm5ds" Jul 21 02:20:41.912752 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.912223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695f675644-sm5ds" event={"ID":"85895277-c10e-4db2-ac45-2a21be115b59","Type":"ContainerDied","Data":"6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61"} Jul 21 02:20:41.912752 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.912282 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-695f675644-sm5ds" event={"ID":"85895277-c10e-4db2-ac45-2a21be115b59","Type":"ContainerDied","Data":"2e48fd80bdd426066d57ea779049cfcd51bad627e4c0425261974f027d085b71"} Jul 21 02:20:41.912752 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.912300 2565 scope.go:117] "RemoveContainer" containerID="6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61" Jul 21 02:20:41.922587 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.922567 2565 scope.go:117] "RemoveContainer" containerID="6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61" Jul 21 02:20:41.922842 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:20:41.922822 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61\": container with ID starting with 6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61 not found: ID does not exist" containerID="6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61" Jul 21 02:20:41.922919 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.922847 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61"} err="failed to get container status \"6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61\": rpc error: code = NotFound desc = could not find container \"6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61\": container with ID starting with 6ecd56b5ff86f010eb272dd33b8d774bb44496d5141a9a0b6a60267b4c1b7d61 not found: ID does not exist" Jul 21 02:20:41.936771 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.936752 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-695f675644-sm5ds"] Jul 21 02:20:41.942169 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:41.942148 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-695f675644-sm5ds"] Jul 21 02:20:42.127128 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:42.127095 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85895277-c10e-4db2-ac45-2a21be115b59" path="/var/lib/kubelet/pods/85895277-c10e-4db2-ac45-2a21be115b59/volumes" Jul 21 02:20:42.666838 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:42.666809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:20:42.828087 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:20:42.828053 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:21:05.832943 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:21:05.832904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:22:48.408234 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:22:48.408193 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:22:49.580775 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:22:49.580684 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:28.909355 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:28.909311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:29.013153 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:29.013114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:32.254219 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:32.254184 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:32.357089 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:32.357058 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:32.523435 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:32.523364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:38.616045 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:38.616008 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:38.767982 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:38.767955 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:38.868082 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:38.868017 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:38.968888 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:38.968851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:45.226667 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:45.226615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:23:45.341074 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:23:45.341042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:24:28.071225 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:24:28.071190 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:24:28.071928 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:24:28.071912 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:25:54.493018 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:25:54.492917 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:25:56.627692 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:25:56.627658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:27:25.162656 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:27:25.162617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:29:28.109198 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:29:28.109174 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:29:28.110589 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:29:28.110567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:30:00.147500 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.147464 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq"] Jul 21 02:30:00.148089 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.148070 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85895277-c10e-4db2-ac45-2a21be115b59" containerName="authorino" Jul 21 02:30:00.148166 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.148090 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85895277-c10e-4db2-ac45-2a21be115b59" containerName="authorino" Jul 21 02:30:00.148216 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.148184 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85895277-c10e-4db2-ac45-2a21be115b59" containerName="authorino" Jul 21 02:30:00.151281 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.151238 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" Jul 21 02:30:00.154610 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.154590 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-9ztgj\"" Jul 21 02:30:00.159397 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.159373 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq"] Jul 21 02:30:00.160878 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.160861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" Jul 21 02:30:00.295159 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.295139 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq"] Jul 21 02:30:00.297065 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:30:00.297041 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0146a5d0_0e00_459c_a1b4_13c1d63a952c.slice/crio-3b900eb4adfacba97fa7d900a1337079645f66481f07723d118d75b3f8054148 WatchSource:0}: Error finding container 3b900eb4adfacba97fa7d900a1337079645f66481f07723d118d75b3f8054148: Status 404 returned error can't find the container with id 3b900eb4adfacba97fa7d900a1337079645f66481f07723d118d75b3f8054148 Jul 21 02:30:00.298977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:00.298959 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 02:30:01.040045 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:01.040004 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" event={"ID":"0146a5d0-0e00-459c-a1b4-13c1d63a952c","Type":"ContainerStarted","Data":"3b900eb4adfacba97fa7d900a1337079645f66481f07723d118d75b3f8054148"} Jul 21 02:30:03.056271 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:03.056151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" event={"ID":"0146a5d0-0e00-459c-a1b4-13c1d63a952c","Type":"ContainerStarted","Data":"b25cc0fe7b50a6a9c1d446c5effeb56b66d23ba35667e532a489100d9f618959"} Jul 21 02:30:03.073018 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:03.072975 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" podStartSLOduration=0.833197448 podStartE2EDuration="3.072960172s" totalImagesPullingTime="2.239762724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:30:03.072678595 +0000 UTC m=+1235.995357720" watchObservedRunningTime="2026-07-21 02:30:03.072960172 +0000 UTC m=+1235.995639279" Jul 21 02:30:04.063641 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:04.063609 2565 generic.go:356] "Generic (PLEG): container finished" podID="0146a5d0-0e00-459c-a1b4-13c1d63a952c" containerID="b25cc0fe7b50a6a9c1d446c5effeb56b66d23ba35667e532a489100d9f618959" exitCode=0 Jul 21 02:30:04.064028 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:04.063689 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" event={"ID":"0146a5d0-0e00-459c-a1b4-13c1d63a952c","Type":"ContainerDied","Data":"b25cc0fe7b50a6a9c1d446c5effeb56b66d23ba35667e532a489100d9f618959"} Jul 21 02:30:05.195618 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:05.195596 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" Jul 21 02:30:06.075629 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:06.075598 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" Jul 21 02:30:06.075857 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:06.075598 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743350-278hq" event={"ID":"0146a5d0-0e00-459c-a1b4-13c1d63a952c","Type":"ContainerDied","Data":"3b900eb4adfacba97fa7d900a1337079645f66481f07723d118d75b3f8054148"} Jul 21 02:30:06.075857 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:30:06.075730 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b900eb4adfacba97fa7d900a1337079645f66481f07723d118d75b3f8054148" Jul 21 02:31:04.742688 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:04.742647 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:31:34.451507 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:34.451475 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:31:47.785609 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.785577 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92"] Jul 21 02:31:47.786173 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.786158 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0146a5d0-0e00-459c-a1b4-13c1d63a952c" containerName="cleanup" Jul 21 02:31:47.786217 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.786177 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0146a5d0-0e00-459c-a1b4-13c1d63a952c" containerName="cleanup" Jul 21 02:31:47.786296 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.786285 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0146a5d0-0e00-459c-a1b4-13c1d63a952c" containerName="cleanup" Jul 21 02:31:47.789637 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.789621 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:47.792718 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.792623 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-3c99fe5f-kserve-self-signed-certs\"" Jul 21 02:31:47.804693 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.800356 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92"] Jul 21 02:31:47.811013 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.810990 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:31:47.911673 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.911647 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-dshm\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:47.911792 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.911700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-model-cache\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:47.911792 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.911738 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d9d1a3-2907-4a61-836c-70652c9b7c33-tls-certs\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:47.911868 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.911820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-tmp-dir\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:47.911868 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.911843 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-home\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:47.911868 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:47.911858 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz9bm\" (UniqueName: \"kubernetes.io/projected/85d9d1a3-2907-4a61-836c-70652c9b7c33-kube-api-access-qz9bm\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.012692 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.012659 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-model-cache\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.012822 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.012700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d9d1a3-2907-4a61-836c-70652c9b7c33-tls-certs\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.012822 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.012754 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-tmp-dir\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.012822 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.012786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-home\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.012822 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.012810 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz9bm\" (UniqueName: \"kubernetes.io/projected/85d9d1a3-2907-4a61-836c-70652c9b7c33-kube-api-access-qz9bm\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.012966 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.012855 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-dshm\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.013130 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.013110 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-model-cache\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.013167 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.013142 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-tmp-dir\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.013224 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.013168 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-home\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.014997 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.014977 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-dshm\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.015244 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.015227 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d9d1a3-2907-4a61-836c-70652c9b7c33-tls-certs\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.022358 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.022339 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz9bm\" (UniqueName: \"kubernetes.io/projected/85d9d1a3-2907-4a61-836c-70652c9b7c33-kube-api-access-qz9bm\") pod \"e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.105778 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.105723 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:48.235273 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.235233 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92"] Jul 21 02:31:48.236425 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:31:48.236390 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85d9d1a3_2907_4a61_836c_70652c9b7c33.slice/crio-987858eeb325c2609bef4c25d90d6892623c1ee85ff74f1697489ef37bb257f4 WatchSource:0}: Error finding container 987858eeb325c2609bef4c25d90d6892623c1ee85ff74f1697489ef37bb257f4: Status 404 returned error can't find the container with id 987858eeb325c2609bef4c25d90d6892623c1ee85ff74f1697489ef37bb257f4 Jul 21 02:31:48.649550 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.649517 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" event={"ID":"85d9d1a3-2907-4a61-836c-70652c9b7c33","Type":"ContainerStarted","Data":"4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14"} Jul 21 02:31:48.649722 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.649558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" event={"ID":"85d9d1a3-2907-4a61-836c-70652c9b7c33","Type":"ContainerStarted","Data":"987858eeb325c2609bef4c25d90d6892623c1ee85ff74f1697489ef37bb257f4"} Jul 21 02:31:48.669504 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:48.669460 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" podStartSLOduration=1.669446738 podStartE2EDuration="1.669446738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 02:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:31:48.667628307 +0000 UTC m=+1341.590307414" watchObservedRunningTime="2026-07-21 02:31:48.669446738 +0000 UTC m=+1341.592125846" Jul 21 02:31:58.106074 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:58.106043 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:58.106534 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:58.106088 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:58.117745 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:58.117721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:31:58.729236 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:31:58.729201 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:32:30.906913 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:30.906857 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:32:31.132405 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:31.132373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:32:32.500632 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:32.500597 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92"] Jul 21 02:32:32.525451 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:32.525421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:32:47.520351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.520313 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" podUID="85d9d1a3-2907-4a61-836c-70652c9b7c33" containerName="main" containerID="cri-o://4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14" gracePeriod=45 Jul 21 02:32:47.772959 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.772903 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:32:47.830120 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830086 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-home\") pod \"85d9d1a3-2907-4a61-836c-70652c9b7c33\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " Jul 21 02:32:47.830351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830149 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-dshm\") pod \"85d9d1a3-2907-4a61-836c-70652c9b7c33\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " Jul 21 02:32:47.830351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830170 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz9bm\" (UniqueName: \"kubernetes.io/projected/85d9d1a3-2907-4a61-836c-70652c9b7c33-kube-api-access-qz9bm\") pod \"85d9d1a3-2907-4a61-836c-70652c9b7c33\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " Jul 21 02:32:47.830351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830188 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-tmp-dir\") pod \"85d9d1a3-2907-4a61-836c-70652c9b7c33\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " Jul 21 02:32:47.830351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830237 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d9d1a3-2907-4a61-836c-70652c9b7c33-tls-certs\") pod \"85d9d1a3-2907-4a61-836c-70652c9b7c33\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " Jul 21 02:32:47.830351 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830277 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-model-cache\") pod \"85d9d1a3-2907-4a61-836c-70652c9b7c33\" (UID: \"85d9d1a3-2907-4a61-836c-70652c9b7c33\") " Jul 21 02:32:47.830603 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830438 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-home" (OuterVolumeSpecName: "home") pod "85d9d1a3-2907-4a61-836c-70652c9b7c33" (UID: "85d9d1a3-2907-4a61-836c-70652c9b7c33"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:32:47.830603 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830534 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "85d9d1a3-2907-4a61-836c-70652c9b7c33" (UID: "85d9d1a3-2907-4a61-836c-70652c9b7c33"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:32:47.830603 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830580 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-model-cache" (OuterVolumeSpecName: "model-cache") pod "85d9d1a3-2907-4a61-836c-70652c9b7c33" (UID: "85d9d1a3-2907-4a61-836c-70652c9b7c33"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:32:47.830858 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830837 2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-tmp-dir\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:32:47.830858 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830858 2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-model-cache\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:32:47.831013 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.830870 2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-home\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:32:47.832324 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.832298 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-dshm" (OuterVolumeSpecName: "dshm") pod "85d9d1a3-2907-4a61-836c-70652c9b7c33" (UID: "85d9d1a3-2907-4a61-836c-70652c9b7c33"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 02:32:47.832687 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.832666 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85d9d1a3-2907-4a61-836c-70652c9b7c33-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "85d9d1a3-2907-4a61-836c-70652c9b7c33" (UID: "85d9d1a3-2907-4a61-836c-70652c9b7c33"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 02:32:47.832754 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.832715 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d9d1a3-2907-4a61-836c-70652c9b7c33-kube-api-access-qz9bm" (OuterVolumeSpecName: "kube-api-access-qz9bm") pod "85d9d1a3-2907-4a61-836c-70652c9b7c33" (UID: "85d9d1a3-2907-4a61-836c-70652c9b7c33"). InnerVolumeSpecName "kube-api-access-qz9bm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 02:32:47.932152 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.932098 2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85d9d1a3-2907-4a61-836c-70652c9b7c33-dshm\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:32:47.932152 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.932148 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz9bm\" (UniqueName: \"kubernetes.io/projected/85d9d1a3-2907-4a61-836c-70652c9b7c33-kube-api-access-qz9bm\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:32:47.932152 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.932160 2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85d9d1a3-2907-4a61-836c-70652c9b7c33-tls-certs\") on node \"ip-10-0-137-128.ec2.internal\" DevicePath \"\"" Jul 21 02:32:47.990863 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.990827 2565 generic.go:356] "Generic (PLEG): container finished" podID="85d9d1a3-2907-4a61-836c-70652c9b7c33" containerID="4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14" exitCode=0 Jul 21 02:32:47.991051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.990878 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" Jul 21 02:32:47.991051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.990912 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" event={"ID":"85d9d1a3-2907-4a61-836c-70652c9b7c33","Type":"ContainerDied","Data":"4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14"} Jul 21 02:32:47.991051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.990964 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92" event={"ID":"85d9d1a3-2907-4a61-836c-70652c9b7c33","Type":"ContainerDied","Data":"987858eeb325c2609bef4c25d90d6892623c1ee85ff74f1697489ef37bb257f4"} Jul 21 02:32:47.991051 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:47.990990 2565 scope.go:117] "RemoveContainer" containerID="4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14" Jul 21 02:32:48.000751 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:48.000734 2565 scope.go:117] "RemoveContainer" containerID="4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14" Jul 21 02:32:48.001001 ip-10-0-137-128 kubenswrapper[2565]: E0721 02:32:48.000987 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14\": container with ID starting with 4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14 not found: ID does not exist" containerID="4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14" Jul 21 02:32:48.001044 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:48.001012 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14"} err="failed to get container status \"4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14\": rpc error: code = NotFound desc = could not find container \"4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14\": container with ID starting with 4d64fc814f3f5f44c88bee7d9ac21b1038aca3a7c18966d425347367e6c42d14 not found: ID does not exist" Jul 21 02:32:48.017273 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:48.017211 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92"] Jul 21 02:32:48.020014 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:48.019994 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-3c99fe5f-kserve-86cb66d54c-rwk92"] Jul 21 02:32:48.126659 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:32:48.126573 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85d9d1a3-2907-4a61-836c-70652c9b7c33" path="/var/lib/kubelet/pods/85d9d1a3-2907-4a61-836c-70652c9b7c33/volumes" Jul 21 02:33:48.208462 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:33:48.208428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:33:48.266472 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:33:48.266445 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:34:28.153959 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:34:28.153928 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:34:28.157175 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:34:28.157144 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:35:41.818990 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:41.818957 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9697689-f89w8_5a9563cb-1b4e-43c0-a688-4782fca81a6c/authorino/0.log" Jul 21 02:35:47.955229 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:47.955173 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8475997445-6zxd6_8adeea6c-f7f0-4ad0-8c60-66e764017f56/manager/0.log" Jul 21 02:35:47.961572 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:47.961553 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8475997445-6zxd6_8adeea6c-f7f0-4ad0-8c60-66e764017f56/copy-manifests/0.log" Jul 21 02:35:48.407084 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:48.407058 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743350-278hq_0146a5d0-0e00-459c-a1b4-13c1d63a952c/cleanup/0.log" Jul 21 02:35:49.293128 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.293097 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h_4555acaf-3af4-4f63-8947-d842a59886ec/extract/0.log" Jul 21 02:35:49.299446 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.299423 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h_4555acaf-3af4-4f63-8947-d842a59886ec/util/0.log" Jul 21 02:35:49.306278 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.306227 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h_4555acaf-3af4-4f63-8947-d842a59886ec/pull/0.log" Jul 21 02:35:49.420744 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.420717 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b_d698df2e-cc5a-4306-842c-95cc84b3a81e/util/0.log" Jul 21 02:35:49.429398 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.429376 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b_d698df2e-cc5a-4306-842c-95cc84b3a81e/pull/0.log" Jul 21 02:35:49.436272 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.436237 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b_d698df2e-cc5a-4306-842c-95cc84b3a81e/extract/0.log" Jul 21 02:35:49.558155 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.558084 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv_9b205e1a-d13a-4163-89c8-e296b6ac8e1d/util/0.log" Jul 21 02:35:49.564653 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.564630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv_9b205e1a-d13a-4163-89c8-e296b6ac8e1d/pull/0.log" Jul 21 02:35:49.571370 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.571353 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv_9b205e1a-d13a-4163-89c8-e296b6ac8e1d/extract/0.log" Jul 21 02:35:49.683935 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.683909 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw_ce870562-8c97-4f9a-a9a9-1d34c9453638/util/0.log" Jul 21 02:35:49.690127 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.690101 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw_ce870562-8c97-4f9a-a9a9-1d34c9453638/pull/0.log" Jul 21 02:35:49.697431 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.697410 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw_ce870562-8c97-4f9a-a9a9-1d34c9453638/extract/0.log" Jul 21 02:35:49.824482 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.824428 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9697689-f89w8_5a9563cb-1b4e-43c0-a688-4782fca81a6c/authorino/0.log" Jul 21 02:35:49.945202 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:49.945184 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n6w9w_ccc2d777-4bff-42fa-925b-87aa1bf92a55/manager/0.log" Jul 21 02:35:50.303359 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:50.303328 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8q4qg_fedd4bc8-0378-479b-9f76-3996152cba11/registry-server/0.log" Jul 21 02:35:50.714746 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:50.714681 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n45hj_78685cb1-811c-46ff-b6dd-e6c8c562f42e/manager/0.log" Jul 21 02:35:51.067336 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:51.067306 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dv7mfq_1b64de6f-9e9b-4ecc-80ec-546b74692635/istio-proxy/0.log" Jul 21 02:35:51.564723 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:51.564696 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74949dcd89-qbjnm_ca0be838-70cd-4e14-af4a-f65915c2af25/istio-proxy/1.log" Jul 21 02:35:51.959444 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:51.959372 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d48988cd-47vhx_9c35362b-794d-4372-9acf-228dfbae4c87/router/0.log" Jul 21 02:35:52.403722 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:52.403686 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-ljgfh_31ffb766-1e9d-429e-91c9-80d6fe940a82/main/0.log" Jul 21 02:35:52.630442 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:35:52.630407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2mzvc_908ceb08-0116-415a-b189-34c96f5cef7e/main/0.log" Jul 21 02:36:00.030108 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:00.030063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:36:00.105518 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:00.105486 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" limit=1024 Jul 21 02:36:01.234113 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:01.234080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dlvc8_6506f074-f794-43ca-9b7f-59c5ad3ef8b9/global-pull-secret-syncer/0.log" Jul 21 02:36:01.362299 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:01.362271 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-444p8_5df84131-c0e2-4311-898d-577cbaa51e3c/konnectivity-agent/0.log" Jul 21 02:36:01.437016 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:01.436985 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-128.ec2.internal_b97019cada6ca6a03a3f478301c10efa/haproxy/0.log" Jul 21 02:36:05.960440 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:05.960413 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h_4555acaf-3af4-4f63-8947-d842a59886ec/extract/0.log" Jul 21 02:36:05.976120 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:05.976095 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h_4555acaf-3af4-4f63-8947-d842a59886ec/util/0.log" Jul 21 02:36:06.001800 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.001775 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rdk6h_4555acaf-3af4-4f63-8947-d842a59886ec/pull/0.log" Jul 21 02:36:06.030280 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.030245 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b_d698df2e-cc5a-4306-842c-95cc84b3a81e/extract/0.log" Jul 21 02:36:06.052090 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.052071 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b_d698df2e-cc5a-4306-842c-95cc84b3a81e/util/0.log" Jul 21 02:36:06.070557 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.070540 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gpw2b_d698df2e-cc5a-4306-842c-95cc84b3a81e/pull/0.log" Jul 21 02:36:06.096698 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.096682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv_9b205e1a-d13a-4163-89c8-e296b6ac8e1d/extract/0.log" Jul 21 02:36:06.113121 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.113103 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv_9b205e1a-d13a-4163-89c8-e296b6ac8e1d/util/0.log" Jul 21 02:36:06.143365 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.143346 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73t2gmv_9b205e1a-d13a-4163-89c8-e296b6ac8e1d/pull/0.log" Jul 21 02:36:06.170925 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.170906 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw_ce870562-8c97-4f9a-a9a9-1d34c9453638/extract/0.log" Jul 21 02:36:06.190713 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.190694 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw_ce870562-8c97-4f9a-a9a9-1d34c9453638/util/0.log" Jul 21 02:36:06.212682 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.212629 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n9vgw_ce870562-8c97-4f9a-a9a9-1d34c9453638/pull/0.log" Jul 21 02:36:06.614615 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.614584 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9697689-f89w8_5a9563cb-1b4e-43c0-a688-4782fca81a6c/authorino/0.log" Jul 21 02:36:06.641947 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.641927 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n6w9w_ccc2d777-4bff-42fa-925b-87aa1bf92a55/manager/0.log" Jul 21 02:36:06.733458 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.733439 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8q4qg_fedd4bc8-0378-479b-9f76-3996152cba11/registry-server/0.log" Jul 21 02:36:06.977101 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:06.977021 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n45hj_78685cb1-811c-46ff-b6dd-e6c8c562f42e/manager/0.log" Jul 21 02:36:08.702267 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.702241 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13da0700-98b6-4671-ad0b-897f281f2f5c/alertmanager/0.log" Jul 21 02:36:08.723638 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.723615 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13da0700-98b6-4671-ad0b-897f281f2f5c/config-reloader/0.log" Jul 21 02:36:08.751197 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.751177 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13da0700-98b6-4671-ad0b-897f281f2f5c/kube-rbac-proxy-web/0.log" Jul 21 02:36:08.771405 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.771381 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13da0700-98b6-4671-ad0b-897f281f2f5c/kube-rbac-proxy/0.log" Jul 21 02:36:08.790356 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.790336 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13da0700-98b6-4671-ad0b-897f281f2f5c/kube-rbac-proxy-metric/0.log" Jul 21 02:36:08.811052 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.811034 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13da0700-98b6-4671-ad0b-897f281f2f5c/prom-label-proxy/0.log" Jul 21 02:36:08.829576 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.829560 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_13da0700-98b6-4671-ad0b-897f281f2f5c/init-config-reloader/0.log" Jul 21 02:36:08.867751 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:08.867728 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-csxl9_fe890ada-031a-4051-b343-05fa32dadc64/cluster-monitoring-operator/0.log" Jul 21 02:36:09.035490 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.035466 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kwzf_b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7/node-exporter/0.log" Jul 21 02:36:09.052977 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.052955 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kwzf_b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7/kube-rbac-proxy/0.log" Jul 21 02:36:09.077945 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.077922 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5kwzf_b5f8e11a-901f-46ae-aaba-bd0a7e38c6b7/init-textfile/0.log" Jul 21 02:36:09.553454 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.553415 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc49b7447-th4ps_1c1240b7-8ad7-455d-a3ab-cbef9b1c8443/telemeter-client/0.log" Jul 21 02:36:09.573392 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.573364 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc49b7447-th4ps_1c1240b7-8ad7-455d-a3ab-cbef9b1c8443/reload/0.log" Jul 21 02:36:09.590283 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.590241 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6cc49b7447-th4ps_1c1240b7-8ad7-455d-a3ab-cbef9b1c8443/kube-rbac-proxy/0.log" Jul 21 02:36:09.614912 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.614889 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8644ff996c-552h8_58d29a7f-73f7-4a56-9b06-7bdd9d808f9d/thanos-query/0.log" Jul 21 02:36:09.643642 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.643626 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8644ff996c-552h8_58d29a7f-73f7-4a56-9b06-7bdd9d808f9d/kube-rbac-proxy-web/0.log" Jul 21 02:36:09.658908 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.658891 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8644ff996c-552h8_58d29a7f-73f7-4a56-9b06-7bdd9d808f9d/kube-rbac-proxy/0.log" Jul 21 02:36:09.697447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.697421 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8644ff996c-552h8_58d29a7f-73f7-4a56-9b06-7bdd9d808f9d/prom-label-proxy/0.log" Jul 21 02:36:09.719838 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.719820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8644ff996c-552h8_58d29a7f-73f7-4a56-9b06-7bdd9d808f9d/kube-rbac-proxy-rules/0.log" Jul 21 02:36:09.743356 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:09.743340 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8644ff996c-552h8_58d29a7f-73f7-4a56-9b06-7bdd9d808f9d/kube-rbac-proxy-metrics/0.log" Jul 21 02:36:10.906647 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:10.906615 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-xf9hz_e5f97723-7100-417b-bf2e-a686913b1f61/networking-console-plugin/0.log" Jul 21 02:36:11.070180 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.070148 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7"] Jul 21 02:36:11.070596 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.070583 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85d9d1a3-2907-4a61-836c-70652c9b7c33" containerName="main" Jul 21 02:36:11.070654 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.070597 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="85d9d1a3-2907-4a61-836c-70652c9b7c33" containerName="main" Jul 21 02:36:11.070694 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.070658 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="85d9d1a3-2907-4a61-836c-70652c9b7c33" containerName="main" Jul 21 02:36:11.073735 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.073720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.076814 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.076794 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7t9d2\"/\"default-dockercfg-5dns8\"" Jul 21 02:36:11.078517 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.078502 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7t9d2\"/\"kube-root-ca.crt\"" Jul 21 02:36:11.078636 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.078505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7t9d2\"/\"openshift-service-ca.crt\"" Jul 21 02:36:11.085041 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.085019 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7"] Jul 21 02:36:11.105303 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.105277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqk4z\" (UniqueName: \"kubernetes.io/projected/8df94f9f-08ba-4d14-a97e-f44edbba452d-kube-api-access-qqk4z\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.105396 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.105316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-podres\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.105396 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.105354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-sys\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.105396 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.105384 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-proc\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.105498 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.105410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-lib-modules\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206031 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.205965 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqk4z\" (UniqueName: \"kubernetes.io/projected/8df94f9f-08ba-4d14-a97e-f44edbba452d-kube-api-access-qqk4z\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206031 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.205996 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-podres\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206031 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.206021 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-sys\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.206055 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-proc\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.206075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-lib-modules\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.206147 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-sys\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.206140 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-podres\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.206189 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-proc\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.206284 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.206218 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8df94f9f-08ba-4d14-a97e-f44edbba452d-lib-modules\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.215175 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.215157 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqk4z\" (UniqueName: \"kubernetes.io/projected/8df94f9f-08ba-4d14-a97e-f44edbba452d-kube-api-access-qqk4z\") pod \"perf-node-gather-daemonset-zpfp7\" (UID: \"8df94f9f-08ba-4d14-a97e-f44edbba452d\") " pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.384695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.384673 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:11.513568 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.513542 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7"] Jul 21 02:36:11.514828 ip-10-0-137-128 kubenswrapper[2565]: W0721 02:36:11.514803 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8df94f9f_08ba_4d14_a97e_f44edbba452d.slice/crio-d327432bd4176b414830fd2ecaf56235c3eda560f881fc43a5fc48c78e09b9ce WatchSource:0}: Error finding container d327432bd4176b414830fd2ecaf56235c3eda560f881fc43a5fc48c78e09b9ce: Status 404 returned error can't find the container with id d327432bd4176b414830fd2ecaf56235c3eda560f881fc43a5fc48c78e09b9ce Jul 21 02:36:11.550081 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.550055 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/2.log" Jul 21 02:36:11.557062 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:11.557038 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-xpmg4_bd6b434b-ab4b-44ee-b840-32249baf5b53/console-operator/3.log" Jul 21 02:36:12.016447 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:12.016423 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-747dcf89b6-p977t_de5fd979-ddce-47d7-b018-a78628f70729/console/0.log" Jul 21 02:36:12.172402 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:12.172369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" event={"ID":"8df94f9f-08ba-4d14-a97e-f44edbba452d","Type":"ContainerStarted","Data":"21c07bd8489ef52a88646628bf8cbfcc3eac1efcd542282468cfbbec3939df95"} Jul 21 02:36:12.172538 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:12.172420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" event={"ID":"8df94f9f-08ba-4d14-a97e-f44edbba452d","Type":"ContainerStarted","Data":"d327432bd4176b414830fd2ecaf56235c3eda560f881fc43a5fc48c78e09b9ce"} Jul 21 02:36:12.172538 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:12.172467 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:12.188983 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:12.188942 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" podStartSLOduration=1.188931048 podStartE2EDuration="1.188931048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 02:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 02:36:12.188378413 +0000 UTC m=+1605.111057544" watchObservedRunningTime="2026-07-21 02:36:12.188931048 +0000 UTC m=+1605.111610154" Jul 21 02:36:12.598325 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:12.598299 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-njk5f_a1d9f8d6-93dc-4eb7-8163-1888f1fa449c/volume-data-source-validator/0.log" Jul 21 02:36:13.642983 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:13.642961 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nf96x_353548bf-2b65-42c8-8a63-b3aed85eea7d/dns/0.log" Jul 21 02:36:13.659493 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:13.659472 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nf96x_353548bf-2b65-42c8-8a63-b3aed85eea7d/kube-rbac-proxy/0.log" Jul 21 02:36:13.725781 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:13.725756 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zsfmr_0b15c5c6-0cb8-4289-975e-1bdb353d3354/dns-node-resolver/0.log" Jul 21 02:36:14.267557 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:14.267530 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-24cm6_d455697e-d0df-4cb5-b012-f9d13f779d14/node-ca/0.log" Jul 21 02:36:15.211119 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:15.211084 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dv7mfq_1b64de6f-9e9b-4ecc-80ec-546b74692635/istio-proxy/0.log" Jul 21 02:36:15.351291 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:15.351243 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74949dcd89-qbjnm_ca0be838-70cd-4e14-af4a-f65915c2af25/istio-proxy/0.log" Jul 21 02:36:15.401559 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:15.401530 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74949dcd89-qbjnm_ca0be838-70cd-4e14-af4a-f65915c2af25/istio-proxy/1.log" Jul 21 02:36:15.485206 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:15.485122 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d48988cd-47vhx_9c35362b-794d-4372-9acf-228dfbae4c87/router/0.log" Jul 21 02:36:16.064424 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:16.064398 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82r59_164a09f1-2723-4759-9f5e-f358a2d2ab9a/serve-healthcheck-canary/0.log" Jul 21 02:36:16.547234 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:16.547202 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-rc8hc_1612e1fc-af23-4cb9-8539-184a90640300/insights-operator/1.log" Jul 21 02:36:16.547695 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:16.547481 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-rc8hc_1612e1fc-af23-4cb9-8539-184a90640300/insights-operator/0.log" Jul 21 02:36:16.759705 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:16.759675 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gj95b_6481f074-d4d5-477e-8862-78d9812258e0/kube-rbac-proxy/0.log" Jul 21 02:36:16.785511 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:16.785486 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gj95b_6481f074-d4d5-477e-8862-78d9812258e0/exporter/0.log" Jul 21 02:36:16.806895 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:16.806824 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gj95b_6481f074-d4d5-477e-8862-78d9812258e0/extractor/0.log" Jul 21 02:36:18.188164 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:18.188138 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7t9d2/perf-node-gather-daemonset-zpfp7" Jul 21 02:36:19.520574 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:19.520501 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8475997445-6zxd6_8adeea6c-f7f0-4ad0-8c60-66e764017f56/manager/0.log" Jul 21 02:36:19.579137 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:19.579111 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8475997445-6zxd6_8adeea6c-f7f0-4ad0-8c60-66e764017f56/copy-manifests/0.log" Jul 21 02:36:21.069165 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:21.069102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76876d4bcd-t5wlt_69027aa9-cd43-4adb-9475-3847a80325d4/manager/0.log" Jul 21 02:36:21.096392 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:21.096369 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xb264_18193e2e-7dbd-487f-93ba-b33537f751c0/openshift-lws-operator/0.log" Jul 21 02:36:21.172268 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:21.172186 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dv7mfq_1b64de6f-9e9b-4ecc-80ec-546b74692635/istio-proxy/0.log" Jul 21 02:36:21.285432 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:21.285409 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74949dcd89-qbjnm_ca0be838-70cd-4e14-af4a-f65915c2af25/istio-proxy/0.log" Jul 21 02:36:21.332966 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:21.332941 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74949dcd89-qbjnm_ca0be838-70cd-4e14-af4a-f65915c2af25/istio-proxy/1.log" Jul 21 02:36:21.408834 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:21.408813 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d48988cd-47vhx_9c35362b-794d-4372-9acf-228dfbae4c87/router/0.log" Jul 21 02:36:22.406802 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:22.406758 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-554689689dv7mfq_1b64de6f-9e9b-4ecc-80ec-546b74692635/istio-proxy/0.log" Jul 21 02:36:22.532452 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:22.532425 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74949dcd89-qbjnm_ca0be838-70cd-4e14-af4a-f65915c2af25/istio-proxy/0.log" Jul 21 02:36:22.585801 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:22.585773 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-74949dcd89-qbjnm_ca0be838-70cd-4e14-af4a-f65915c2af25/istio-proxy/1.log" Jul 21 02:36:22.654687 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:22.654649 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d48988cd-47vhx_9c35362b-794d-4372-9acf-228dfbae4c87/router/0.log" Jul 21 02:36:26.513892 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:26.513863 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-hb4hw_1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60/kube-storage-version-migrator-operator/1.log" Jul 21 02:36:26.515436 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:26.515413 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-hb4hw_1b72ee4e-d4b1-40b5-abe8-aa0cbabb6e60/kube-storage-version-migrator-operator/0.log" Jul 21 02:36:27.603816 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.603789 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4wk6_f8069911-9c1d-4284-b705-2a8574c285e6/kube-multus-additional-cni-plugins/0.log" Jul 21 02:36:27.618663 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.618637 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4wk6_f8069911-9c1d-4284-b705-2a8574c285e6/egress-router-binary-copy/0.log" Jul 21 02:36:27.633495 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.633479 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4wk6_f8069911-9c1d-4284-b705-2a8574c285e6/cni-plugins/0.log" Jul 21 02:36:27.649798 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.649783 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4wk6_f8069911-9c1d-4284-b705-2a8574c285e6/bond-cni-plugin/0.log" Jul 21 02:36:27.665322 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.665297 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4wk6_f8069911-9c1d-4284-b705-2a8574c285e6/routeoverride-cni/0.log" Jul 21 02:36:27.680460 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.680435 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4wk6_f8069911-9c1d-4284-b705-2a8574c285e6/whereabouts-cni-bincopy/0.log" Jul 21 02:36:27.697032 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.697001 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4wk6_f8069911-9c1d-4284-b705-2a8574c285e6/whereabouts-cni/0.log" Jul 21 02:36:27.915604 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.915534 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wl8hl_0736c8d1-e8cf-4718-ac63-54c3d1adc4af/kube-multus/0.log" Jul 21 02:36:27.965882 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.965856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b94xm_068fa366-3ec1-4827-8a33-9a020304ed14/network-metrics-daemon/0.log" Jul 21 02:36:27.978745 ip-10-0-137-128 kubenswrapper[2565]: I0721 02:36:27.978725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b94xm_068fa366-3ec1-4827-8a33-9a020304ed14/kube-rbac-proxy/0.log"