Jul 10 14:44:55.804913 ip-10-0-133-29 systemd[1]: Starting Kubernetes Kubelet... Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.251494 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260065 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260076 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260080 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260083 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260086 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260089 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260092 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:44:56.304304 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260097 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260101 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260104 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260106 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260109 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260111 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260114 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260117 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260119 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260122 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260125 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260127 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260129 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260132 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260134 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260137 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260140 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260142 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260145 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:44:56.318745 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260149 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260152 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260154 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260157 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260160 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260163 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260166 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260168 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260171 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260173 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260176 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260180 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260189 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260192 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260195 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260198 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260201 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260204 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260206 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260209 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:44:56.321205 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260212 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260214 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260217 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260220 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260222 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260224 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260227 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260230 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260232 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260234 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260237 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260239 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260242 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260246 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260248 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260251 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260254 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260256 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260259 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260262 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:44:56.323176 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260264 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260267 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260270 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260273 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260276 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260283 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260286 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260289 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260292 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260295 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260297 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260300 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260302 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260305 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260307 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260310 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260312 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260317 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260321 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260324 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:44:56.325473 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260327 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260329 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260332 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260335 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260338 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260340 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260343 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260345 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260348 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260350 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260354 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260358 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.260360 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261137 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261144 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261147 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261150 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261154 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261163 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261166 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:44:56.327454 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261169 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261172 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261175 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261180 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261183 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261186 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261189 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261191 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261194 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261196 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261199 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261202 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261205 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261208 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261211 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261213 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261216 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261218 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261221 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261223 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:44:56.335323 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261226 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:44:56.334784 ip-10-0-133-29 systemd[1]: Started Kubernetes Kubelet. Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261228 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261231 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261234 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261236 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261239 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261241 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261244 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261246 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261249 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261251 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261255 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261258 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261261 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261264 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261267 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261270 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261272 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261275 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261278 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:44:56.350926 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261280 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261283 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261286 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261289 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261291 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261294 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261297 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261299 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261302 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261304 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261307 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261309 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261312 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261315 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261317 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261320 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261323 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261327 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261330 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261332 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:44:56.352414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261335 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261338 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261340 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261343 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261348 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261351 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261353 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261356 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261360 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261363 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261365 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261370 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261373 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261377 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261379 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261382 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261385 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261387 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261390 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:44:56.358180 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261392 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261395 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261397 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261400 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261402 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261405 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261407 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261410 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261412 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261414 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261417 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261419 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261422 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261832 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261838 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261842 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261845 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261850 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261853 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:44:56.360590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261856 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261858 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261862 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261865 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261868 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261871 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261874 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261876 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261879 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261881 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261884 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261886 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261889 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261892 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261894 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261896 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261899 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261901 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261904 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261908 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:44:56.362414 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261912 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261914 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261917 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261921 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261924 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261927 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261930 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261932 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261935 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261937 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261941 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261945 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261947 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261950 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261953 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261956 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261958 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261961 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261975 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261978 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:44:56.365865 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261981 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261983 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261986 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261989 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261992 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261995 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.261997 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262000 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262002 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262005 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262007 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262010 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262012 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262014 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262017 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262019 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262022 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262025 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262027 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:44:56.380108 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262030 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262032 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262035 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262038 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262041 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262044 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262047 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262051 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262054 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262056 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262058 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262061 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262064 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262067 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262069 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262072 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262074 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262077 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262081 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:44:56.382891 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262084 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262087 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262090 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262094 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262096 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262099 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262102 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262104 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262106 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262109 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262111 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262114 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262116 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262119 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262121 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262184 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262196 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262202 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262206 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262211 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262216 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 14:44:56.395833 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262219 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262224 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262227 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262230 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262233 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262236 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262239 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262242 2572 flags.go:64] FLAG: --cgroup-root="" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262245 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262248 2572 flags.go:64] FLAG: --client-ca-file="" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262251 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262254 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262258 2572 flags.go:64] FLAG: --cluster-domain="" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262261 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262264 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262267 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262270 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262274 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262277 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262279 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262283 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262286 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262288 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262291 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 14:44:56.543310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262294 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262297 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262301 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262305 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262308 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262311 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262314 2572 flags.go:64] FLAG: --enable-server="true" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262321 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262325 2572 flags.go:64] FLAG: --event-burst="100" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262328 2572 flags.go:64] FLAG: --event-qps="50" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262331 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262334 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262337 2572 flags.go:64] FLAG: --eviction-hard="" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262340 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262343 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262346 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262349 2572 flags.go:64] FLAG: --eviction-soft="" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262352 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262355 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262358 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262360 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262363 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262366 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262368 2572 flags.go:64] FLAG: --feature-gates="" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262372 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 14:44:56.545178 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262375 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262378 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262381 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262384 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262387 2572 flags.go:64] FLAG: --help="false" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262390 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262393 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262396 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262399 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262403 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262407 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262410 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262413 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262416 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262420 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262424 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262427 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262429 2572 flags.go:64] FLAG: --kube-reserved="" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262432 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262435 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262438 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262441 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262443 2572 flags.go:64] FLAG: --lock-file="" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262446 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 14:44:56.562368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262449 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262452 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262457 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262459 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262462 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262465 2572 flags.go:64] FLAG: --logging-format="text" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262467 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262470 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262473 2572 flags.go:64] FLAG: --manifest-url="" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262476 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262483 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262486 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262489 2572 flags.go:64] FLAG: --max-pods="110" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262492 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262495 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262498 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262500 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262503 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262507 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262510 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262517 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262519 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262523 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 14:44:56.577330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262526 2572 flags.go:64] FLAG: --pod-cidr="" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262530 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262535 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262538 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262541 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262544 2572 flags.go:64] FLAG: --port="10250" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262547 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262550 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03bd654658eaacee4" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262553 2572 flags.go:64] FLAG: --qos-reserved="" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262556 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262559 2572 flags.go:64] FLAG: --register-node="true" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262561 2572 flags.go:64] FLAG: --register-with-taints="" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262565 2572 flags.go:64] FLAG: --registry-burst="10" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262568 2572 flags.go:64] FLAG: --registry-qps="5" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262570 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262573 2572 flags.go:64] FLAG: --reserved-memory="" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262577 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262580 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262583 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262585 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262588 2572 flags.go:64] FLAG: --runonce="false" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262591 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262594 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262597 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262599 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 14:44:56.578348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262602 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262605 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262608 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262613 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262616 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262618 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262622 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262625 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262629 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262632 2572 flags.go:64] FLAG: --system-cgroups="" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262647 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262653 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262656 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262659 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262663 2572 flags.go:64] FLAG: --tls-min-version="" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262666 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262668 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262671 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262674 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262677 2572 flags.go:64] FLAG: --v="2" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262681 2572 flags.go:64] FLAG: --version="false" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262684 2572 flags.go:64] FLAG: --vmodule="" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262688 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.262691 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262800 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:44:56.583553 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262804 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262807 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262810 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262813 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262816 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262819 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262821 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262824 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262826 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262829 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262833 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262836 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262838 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262842 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262845 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262847 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262850 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262854 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262856 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262859 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:44:56.584308 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262861 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262865 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262869 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262872 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262874 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262877 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262879 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262882 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262884 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262887 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262889 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262892 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262894 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262897 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262899 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262902 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262904 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262907 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262909 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:44:56.584878 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262911 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262914 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262916 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262920 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262922 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262925 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262930 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262933 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262936 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262939 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262942 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262944 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262947 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262950 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262953 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262956 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262958 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262961 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262964 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:44:56.585419 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262966 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262969 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262971 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262974 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262977 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262979 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262982 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262984 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262986 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262989 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262991 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262994 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262996 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.262999 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263001 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263004 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263008 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263011 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263014 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:44:56.585972 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263018 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263022 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263025 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263027 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263030 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263033 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263036 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263038 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263041 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263043 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263046 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263049 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263051 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263054 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263056 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263058 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263061 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263063 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263066 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263068 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:44:56.586512 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.263071 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.263745 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.270674 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.270687 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.270705 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.270710 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270766 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270771 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270775 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270778 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270781 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270785 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270789 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270793 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:44:56.587060 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270797 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270800 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270803 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270806 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270810 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270813 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270817 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270819 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270822 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270825 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270828 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270830 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270833 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270835 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270838 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270841 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270843 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270846 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270849 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270851 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270854 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:44:56.587492 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270861 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270864 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270866 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270869 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270871 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270874 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270876 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270879 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270881 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270884 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270886 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270889 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270892 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270894 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270896 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270899 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270902 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270905 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270907 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:44:56.588064 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270910 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270913 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270915 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270917 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270920 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270923 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270925 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270928 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270930 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270933 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270935 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270938 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270940 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270946 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270949 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270952 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270954 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270957 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270960 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270962 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:44:56.588608 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270964 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270967 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270969 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270972 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270974 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270977 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270979 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270982 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270984 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270987 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270990 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270992 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270995 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.270999 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271002 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271005 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271007 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271010 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271012 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:44:56.589159 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271015 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271017 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271020 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271022 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271024 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271027 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271032 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271035 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271038 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271040 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271043 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271045 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.271050 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271182 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:44:56.589711 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271187 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271190 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271193 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271196 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271199 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271202 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271205 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271207 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271210 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271213 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271221 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271224 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271226 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271229 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271231 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271234 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271236 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271239 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271241 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:44:56.590442 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271244 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271248 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271251 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271253 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271256 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271260 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271264 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271266 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271270 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271273 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271276 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271279 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271282 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271284 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271287 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271289 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271292 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271295 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271297 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:44:56.591305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271299 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271302 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271304 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271307 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271311 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271319 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271322 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271325 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271328 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271331 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271333 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271336 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271338 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271341 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271343 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271346 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271348 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271350 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271354 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271358 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:44:56.810271 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271361 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271363 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271366 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271369 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271371 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271374 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271376 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271378 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271381 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271384 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271386 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271388 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271391 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271393 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271396 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271399 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271401 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271403 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271411 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271414 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:44:56.811305 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271416 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271419 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271421 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271424 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271426 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271429 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271431 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271433 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271436 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271439 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271443 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271446 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271449 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271451 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271454 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271457 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271459 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271462 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271464 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:44:56.812397 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:56.271467 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.271471 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.271570 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.273918 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.275595 2572 server.go:1019] "Starting client certificate rotation" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.275689 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.275725 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.280520 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.281598 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.297663 2572 log.go:25] "Validated CRI v1 runtime API" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.300078 2572 log.go:25] "Validated CRI v1 image API" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.300829 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 14:44:56.813249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.305006 2572 fs.go:135] Filesystem UUIDs: map[438e5015-fd14-4cb9-8350-12e9a940e917:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fb43b502-fba8-4ae2-9494-56b70644d378:/dev/nvme0n1p3] Jul 10 14:44:56.813900 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.305026 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 14:44:56.813900 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.308473 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.310446 2572 manager.go:216] Machine: {Timestamp:2026-07-10 14:44:56.309159606 +0000 UTC m=+0.370771516 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100140 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bcd881b6adfa89bf97fb8b0e34188 SystemUUID:ec2bcd88-1b6a-dfa8-9bf9-7fb8b0e34188 BootID:562a089f-8aa7-46b3-8d09-15b62f2d9583 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:29:fd:5b:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:29:fd:5b:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:b5:1b:0d:34:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.310540 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.310609 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.313292 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.313321 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-29.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.314127 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.314138 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.314145 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.314158 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.315769 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.318868 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.319017 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.319055 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.319073 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.319096 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.319110 2572 kubelet.go:398] "Adding apiserver pod source" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.319138 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 14:44:56.816575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.319591 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.321169 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.326414 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.328815 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.328842 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.328996 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329007 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329012 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329018 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329025 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329031 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329681 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329688 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329695 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329700 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329708 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.329715 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.331176 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.331185 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.333617 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.333667 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-29.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.333706 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.334123 2572 server.go:1268] "Started kubelet" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.334336 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.334391 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.334661 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.335666 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.336395 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.340028 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.342898 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.342917 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.343146 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.343817 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.343832 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.343864 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.343968 2572 factory.go:55] Registering systemd factory Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.343995 2572 factory.go:223] Registration of the systemd container factory successfully Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.343999 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.344009 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.342990 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-29.ec2.internal.18c0f4e03abdf788 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-29.ec2.internal,UID:ip-10-0-133-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-29.ec2.internal,},FirstTimestamp:2026-07-10 14:44:56.334096264 +0000 UTC m=+0.395708173,LastTimestamp:2026-07-10 14:44:56.334096264 +0000 UTC m=+0.395708173,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-29.ec2.internal,}" Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.344191 2572 factory.go:153] Registering CRI-O factory Jul 10 14:44:56.817452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.344200 2572 factory.go:223] Registration of the crio container factory successfully Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.344240 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.344274 2572 factory.go:103] Registering Raw factory Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.344285 2572 manager.go:1196] Started watching for new ooms in manager Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.344755 2572 manager.go:349] Starting recovery of all containers Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.348827 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-29.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.349032 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.356879 2572 manager.go:354] Recovery completed Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.362376 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t4gsw" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.362430 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.364782 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.364811 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.364821 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.365338 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.365351 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.365366 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.365364 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.366378 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.366424 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.366438 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.366549 2572 policy_none.go:49] "None policy: Start" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.366565 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.366578 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.366669 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-29.ec2.internal.18c0f4e03c926f7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-29.ec2.internal,UID:ip-10-0-133-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-29.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-29.ec2.internal,},FirstTimestamp:2026-07-10 14:44:56.364797821 +0000 UTC m=+0.426409736,LastTimestamp:2026-07-10 14:44:56.364797821 +0000 UTC m=+0.426409736,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-29.ec2.internal,}" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.367543 2572 policy_none.go:47] "Start" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.370416 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t4gsw" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.375385 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-29.ec2.internal.18c0f4e03c92b556 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-29.ec2.internal,UID:ip-10-0-133-29.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-29.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-29.ec2.internal,},FirstTimestamp:2026-07-10 14:44:56.364815702 +0000 UTC m=+0.426427613,LastTimestamp:2026-07-10 14:44:56.364815702 +0000 UTC m=+0.426427613,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-29.ec2.internal,}" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.421792 2572 manager.go:337] "Starting Device Plugin manager" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.421817 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.421826 2572 server.go:87] "Starting device plugin registration server" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.422045 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.422150 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 14:44:56.821943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.422265 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.422356 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.422364 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.422754 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.422792 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.476681 2572 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2605 into the system container \"/system.slice\": " Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.522900 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.523573 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.523597 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.523605 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.523626 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.533754 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.533770 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-29.ec2.internal\": node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.570708 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.601095 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.605533 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.605562 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.605579 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.605629 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.608172 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.671727 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.705871 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal"] Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.705930 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.709350 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.709379 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.709389 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.710537 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.710722 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.710752 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.711939 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.711961 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.711971 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.711940 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.712042 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.712060 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.713293 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.713323 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.713942 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.713963 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.713975 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:44:56.822850 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.744225 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-29.ec2.internal\" not found" node="ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.823902 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.746166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2903f8eb788b190a0f3033955eb56b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal\" (UID: \"2903f8eb788b190a0f3033955eb56b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.823902 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.746190 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2903f8eb788b190a0f3033955eb56b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal\" (UID: \"2903f8eb788b190a0f3033955eb56b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.823902 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.746238 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/652befd04fb49fe2d61e157a118a9cc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-29.ec2.internal\" (UID: \"652befd04fb49fe2d61e157a118a9cc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.823902 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.748524 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-29.ec2.internal\" not found" node="ip-10-0-133-29.ec2.internal" Jul 10 14:44:56.823902 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.773016 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.846864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2903f8eb788b190a0f3033955eb56b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal\" (UID: \"2903f8eb788b190a0f3033955eb56b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.846890 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2903f8eb788b190a0f3033955eb56b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal\" (UID: \"2903f8eb788b190a0f3033955eb56b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.846911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/652befd04fb49fe2d61e157a118a9cc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-29.ec2.internal\" (UID: \"652befd04fb49fe2d61e157a118a9cc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.846955 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/652befd04fb49fe2d61e157a118a9cc4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-29.ec2.internal\" (UID: \"652befd04fb49fe2d61e157a118a9cc4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.846975 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2903f8eb788b190a0f3033955eb56b06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal\" (UID: \"2903f8eb788b190a0f3033955eb56b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:56.846979 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2903f8eb788b190a0f3033955eb56b06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal\" (UID: \"2903f8eb788b190a0f3033955eb56b06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.873962 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:57.019230 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:56.974423 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:57.243055 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.045761 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.243055 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.051256 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" Jul 10 14:44:57.243055 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:57.074994 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:57.243055 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:57.175454 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:57.423237 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.274986 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 14:44:57.423237 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.275109 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 14:44:57.423237 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:57.276056 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:57.423237 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.374892 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 14:39:57 +0000 UTC" deadline="2028-03-18 06:46:41.749726224 +0000 UTC" Jul 10 14:44:57.423237 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.374923 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14800h1m44.374806645s" Jul 10 14:44:57.423237 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:57.377016 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-29.ec2.internal\" not found" Jul 10 14:44:57.423237 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.397765 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:44:58.857612 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.442955 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:44:58.857612 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:57.443061 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" Jul 10 14:44:58.857612 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:58.654137 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:44:58.857612 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:58.656093 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" Jul 10 14:44:58.857612 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:58.687976 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:44:59.107281 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:58.896556 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2903f8eb788b190a0f3033955eb56b06.slice/crio-277359e4b959c9bf61614640372ab3392fa9051951d3ad181fe5270706a8e2fd WatchSource:0}: Error finding container 277359e4b959c9bf61614640372ab3392fa9051951d3ad181fe5270706a8e2fd: Status 404 returned error can't find the container with id 277359e4b959c9bf61614640372ab3392fa9051951d3ad181fe5270706a8e2fd Jul 10 14:44:59.107281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:58.901547 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:44:59.107281 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:58.904495 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652befd04fb49fe2d61e157a118a9cc4.slice/crio-2cf3909a67ac918a2751b55fe036607ab8daf05642d988d36eec961675b63511 WatchSource:0}: Error finding container 2cf3909a67ac918a2751b55fe036607ab8daf05642d988d36eec961675b63511: Status 404 returned error can't find the container with id 2cf3909a67ac918a2751b55fe036607ab8daf05642d988d36eec961675b63511 Jul 10 14:44:59.107281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:58.907339 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.514944 2572 apiserver.go:52] "Watching apiserver" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.523453 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.523882 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2","openshift-dns/node-resolver-pkv9v","openshift-multus/multus-additional-cni-plugins-442lx","openshift-network-operator/iptables-alerter-p9rb8","openshift-ovn-kubernetes/ovnkube-node-l8bbk","kube-system/global-pull-secret-syncer-hp7mt","openshift-cluster-node-tuning-operator/tuned-kfg2h","openshift-image-registry/node-ca-sbzq6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal","openshift-multus/multus-spdfh","openshift-multus/network-metrics-daemon-cs6cg","openshift-network-diagnostics/network-check-target-2pjg8","kube-system/konnectivity-agent-hxz24"] Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.525382 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.525457 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.526662 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.527964 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.528927 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530103 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530425 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zlfcr\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530533 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530717 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8bk4j\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530795 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530904 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530917 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.530985 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.531312 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.531463 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.532544 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.532643 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.533433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.534653 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 14:44:59.535530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.535281 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:44:59.537575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.537296 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 14:44:59.538439 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.537679 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kkgzl\"" Jul 10 14:44:59.538439 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.537877 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9jz44\"" Jul 10 14:44:59.538439 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538005 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 14:44:59.538439 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538304 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 14:44:59.538439 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538408 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 14:44:59.538836 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538449 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-64r7h\"" Jul 10 14:44:59.538836 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538467 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:44:59.538836 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538558 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 14:44:59.538836 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538684 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 14:44:59.539433 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538969 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.539433 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.538996 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 14:44:59.539968 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.539590 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 14:44:59.540300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.540009 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qxw5g\"" Jul 10 14:44:59.540645 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.540466 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 14:44:59.544588 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.542321 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:44:59.544588 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.542390 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:44:59.544588 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.542747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.544777 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.545657 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.548315 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.548358 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.548525 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rgzv8\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.548606 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549251 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549323 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hcg98\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549398 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549467 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549257 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-socket-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549759 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/558ec33e-0f35-4c59-8fde-8e2566be2f5e-agent-certs\") pod \"konnectivity-agent-hxz24\" (UID: \"558ec33e-0f35-4c59-8fde-8e2566be2f5e\") " pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysctl-conf\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549868 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-host-slash\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549888 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf80ce30-07ad-4e45-988b-735088a856b2-dbus\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-systemd\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549923 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-var-lib-kubelet\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549946 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-host\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549967 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31b8b1b2-9382-4555-bcc3-b545d705c7c5-tmp\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.549987 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-run\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.631894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-cni-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550022 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-os-release\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550060 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-device-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cnibin\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-iptables-alerter-script\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffsl\" (UniqueName: \"kubernetes.io/projected/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-kube-api-access-8ffsl\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550156 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-modprobe-d\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysctl-d\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-cnibin\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550213 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-cni-binary-copy\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwf8w\" (UniqueName: \"kubernetes.io/projected/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-kube-api-access-kwf8w\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550277 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/668c6dc2-cade-4e9a-994f-cc374fdad086-host\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550346 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89t9d\" (UniqueName: \"kubernetes.io/projected/7c25f2ef-9cec-48f5-9257-84db67d53ff7-kube-api-access-89t9d\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-hosts-file\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.634301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysconfig\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550425 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-system-cni-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-socket-dir-parent\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-etc-kubernetes\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550476 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550501 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-os-release\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550526 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf80ce30-07ad-4e45-988b-735088a856b2-kubelet-config\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-tuned\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550592 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-multus-certs\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550612 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72cwc\" (UniqueName: \"kubernetes.io/projected/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-kube-api-access-72cwc\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550669 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-registration-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-sys-fs\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550732 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-sys\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550760 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/668c6dc2-cade-4e9a-994f-cc374fdad086-serviceca\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550787 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.635138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550852 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-system-cni-dir\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-lib-modules\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550895 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cr8r\" (UniqueName: \"kubernetes.io/projected/31b8b1b2-9382-4555-bcc3-b545d705c7c5-kube-api-access-6cr8r\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6zhn\" (UniqueName: \"kubernetes.io/projected/668c6dc2-cade-4e9a-994f-cc374fdad086-kube-api-access-p6zhn\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-cni-multus\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.550982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-daemon-config\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/06d1339c-8a34-4c57-ab6c-6e7b979b5272-kube-api-access-5vfkl\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-k8s-cni-cncf-io\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551066 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-cni-bin\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551090 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-conf-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-tmp-dir\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551134 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4kc7\" (UniqueName: \"kubernetes.io/projected/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-kube-api-access-g4kc7\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cni-binary-copy\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551203 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-kubernetes\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-netns\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.636203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-kubelet\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551275 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-hostroot\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.551372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/558ec33e-0f35-4c59-8fde-8e2566be2f5e-konnectivity-ca\") pod \"konnectivity-agent-hxz24\" (UID: \"558ec33e-0f35-4c59-8fde-8e2566be2f5e\") " pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.554606 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.555415 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcl74\"" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.555521 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.569855 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.601254 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8fzdk" Jul 10 14:44:59.637068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.614111 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8fzdk" Jul 10 14:44:59.641291 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.639899 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652297 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-hosts-file\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysconfig\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-system-cni-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652398 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-socket-dir-parent\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652420 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-etc-kubernetes\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652426 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-hosts-file\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-etc-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-var-lib-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652557 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-cni-bin\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-os-release\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf80ce30-07ad-4e45-988b-735088a856b2-kubelet-config\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-tuned\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652654 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-socket-dir-parent\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-multus-certs\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.750527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652695 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72cwc\" (UniqueName: \"kubernetes.io/projected/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-kube-api-access-72cwc\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652721 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-run-netns\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652729 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-etc-kubernetes\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-registration-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-sys-fs\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652792 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-system-cni-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652843 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-sys\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652869 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/668c6dc2-cade-4e9a-994f-cc374fdad086-serviceca\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652879 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652501 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysconfig\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652892 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-ovn\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652956 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.652985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-system-cni-dir\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653060 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-lib-modules\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cr8r\" (UniqueName: \"kubernetes.io/projected/31b8b1b2-9382-4555-bcc3-b545d705c7c5-kube-api-access-6cr8r\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.751556 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6zhn\" (UniqueName: \"kubernetes.io/projected/668c6dc2-cade-4e9a-994f-cc374fdad086-kube-api-access-p6zhn\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-cni-multus\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653164 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-daemon-config\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-cni-netd\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/06d1339c-8a34-4c57-ab6c-6e7b979b5272-kube-api-access-5vfkl\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653254 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-os-release\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653254 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-registration-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-k8s-cni-cncf-io\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-cni-bin\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653300 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-sys-fs\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653312 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cf80ce30-07ad-4e45-988b-735088a856b2-kubelet-config\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-conf-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653360 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-conf-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653382 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-sys\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv2fm\" (UniqueName: \"kubernetes.io/projected/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-kube-api-access-vv2fm\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653419 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-tmp-dir\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.752834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4kc7\" (UniqueName: \"kubernetes.io/projected/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-kube-api-access-g4kc7\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653463 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cni-binary-copy\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653500 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653505 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653512 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653529 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-kubernetes\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653555 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-netns\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653580 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-kubelet\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653571 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-system-cni-dir\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-lib-modules\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653705 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-hostroot\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653729 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653785 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/558ec33e-0f35-4c59-8fde-8e2566be2f5e-konnectivity-ca\") pod \"konnectivity-agent-hxz24\" (UID: \"558ec33e-0f35-4c59-8fde-8e2566be2f5e\") " pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-systemd-units\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/668c6dc2-cade-4e9a-994f-cc374fdad086-serviceca\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-log-socket\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653930 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-cni-bin\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-hostroot\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.754127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.653979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovnkube-config\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654001 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-multus-certs\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovn-node-metrics-cert\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654050 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-socket-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654088 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/558ec33e-0f35-4c59-8fde-8e2566be2f5e-agent-certs\") pod \"konnectivity-agent-hxz24\" (UID: \"558ec33e-0f35-4c59-8fde-8e2566be2f5e\") " pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysctl-conf\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654135 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-k8s-cni-cncf-io\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654157 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654173 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-node-log\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654173 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-tmp-dir\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654244 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-host-slash\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654282 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf80ce30-07ad-4e45-988b-735088a856b2-dbus\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654317 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-systemd\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654380 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-var-lib-kubelet\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654393 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-run-netns\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-host\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.755594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31b8b1b2-9382-4555-bcc3-b545d705c7c5-tmp\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654554 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-run\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-cni-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-os-release\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654630 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-kubelet\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-slash\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654656 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-device-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654702 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-daemon-config\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654731 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-os-release\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654766 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-kubelet\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.654866 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cni-binary-copy\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.654880 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.654955 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs podName:7c25f2ef-9cec-48f5-9257-84db67d53ff7 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:00.154920204 +0000 UTC m=+3.021350495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs") pod "network-metrics-daemon-cs6cg" (UID: "7c25f2ef-9cec-48f5-9257-84db67d53ff7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655146 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-device-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655209 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cnibin\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-iptables-alerter-script\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.756628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655246 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-host-var-lib-cni-multus\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655260 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/06d1339c-8a34-4c57-ab6c-6e7b979b5272-socket-dir\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655267 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffsl\" (UniqueName: \"kubernetes.io/projected/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-kube-api-access-8ffsl\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655313 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/558ec33e-0f35-4c59-8fde-8e2566be2f5e-konnectivity-ca\") pod \"konnectivity-agent-hxz24\" (UID: \"558ec33e-0f35-4c59-8fde-8e2566be2f5e\") " pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655322 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-modprobe-d\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655358 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-host-slash\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655372 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysctl-conf\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655377 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysctl-d\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655323 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-kubernetes\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655430 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-cnibin\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655436 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-run\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-systemd\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655447 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cf80ce30-07ad-4e45-988b-735088a856b2-dbus\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655458 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-cni-binary-copy\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-host\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655490 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-systemd\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655439 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-multus-cni-dir\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.758120 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.655518 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwf8w\" (UniqueName: \"kubernetes.io/projected/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-kube-api-access-kwf8w\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655541 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-var-lib-kubelet\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655488 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-cnibin\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.655569 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret podName:cf80ce30-07ad-4e45-988b-735088a856b2 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:00.155552534 +0000 UTC m=+3.021982808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret") pod "global-pull-secret-syncer-hp7mt" (UID: "cf80ce30-07ad-4e45-988b-735088a856b2") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655620 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-modprobe-d\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/668c6dc2-cade-4e9a-994f-cc374fdad086-host\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655656 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-sysctl-d\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655681 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/668c6dc2-cade-4e9a-994f-cc374fdad086-host\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655812 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-env-overrides\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89t9d\" (UniqueName: \"kubernetes.io/projected/7c25f2ef-9cec-48f5-9257-84db67d53ff7-kube-api-access-89t9d\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655990 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-cni-binary-copy\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.655999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovnkube-script-lib\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.656073 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-cnibin\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.759857 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.656381 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-iptables-alerter-script\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.657554 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31b8b1b2-9382-4555-bcc3-b545d705c7c5-tmp\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.658075 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31b8b1b2-9382-4555-bcc3-b545d705c7c5-etc-tuned\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.660401 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/558ec33e-0f35-4c59-8fde-8e2566be2f5e-agent-certs\") pod \"konnectivity-agent-hxz24\" (UID: \"558ec33e-0f35-4c59-8fde-8e2566be2f5e\") " pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.672552 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72cwc\" (UniqueName: \"kubernetes.io/projected/b9a4ba6f-04fd-400e-b971-3a94cac6ab08-kube-api-access-72cwc\") pod \"multus-spdfh\" (UID: \"b9a4ba6f-04fd-400e-b971-3a94cac6ab08\") " pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.674314 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.674346 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.674360 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7cwsx for pod openshift-network-diagnostics/network-check-target-2pjg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:44:59.674450 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx podName:37bca1ba-3919-4eb0-a9a7-d2bc40dac515 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:00.174435633 +0000 UTC m=+3.040865922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7cwsx" (UniqueName: "kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx") pod "network-check-target-2pjg8" (UID: "37bca1ba-3919-4eb0-a9a7-d2bc40dac515") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.675600 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vfkl\" (UniqueName: \"kubernetes.io/projected/06d1339c-8a34-4c57-ab6c-6e7b979b5272-kube-api-access-5vfkl\") pod \"aws-ebs-csi-driver-node-pnsw2\" (UID: \"06d1339c-8a34-4c57-ab6c-6e7b979b5272\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.677516 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4kc7\" (UniqueName: \"kubernetes.io/projected/b9adadb8-1cc0-48ab-ad0f-52a587f7abf3-kube-api-access-g4kc7\") pod \"node-resolver-pkv9v\" (UID: \"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3\") " pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.677909 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6zhn\" (UniqueName: \"kubernetes.io/projected/668c6dc2-cade-4e9a-994f-cc374fdad086-kube-api-access-p6zhn\") pod \"node-ca-sbzq6\" (UID: \"668c6dc2-cade-4e9a-994f-cc374fdad086\") " pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.678079 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89t9d\" (UniqueName: \"kubernetes.io/projected/7c25f2ef-9cec-48f5-9257-84db67d53ff7-kube-api-access-89t9d\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.679171 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cr8r\" (UniqueName: \"kubernetes.io/projected/31b8b1b2-9382-4555-bcc3-b545d705c7c5-kube-api-access-6cr8r\") pod \"tuned-kfg2h\" (UID: \"31b8b1b2-9382-4555-bcc3-b545d705c7c5\") " pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.680278 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffsl\" (UniqueName: \"kubernetes.io/projected/fdecfe1c-dd00-4fcb-bd08-84872992e8c1-kube-api-access-8ffsl\") pod \"iptables-alerter-p9rb8\" (UID: \"fdecfe1c-dd00-4fcb-bd08-84872992e8c1\") " pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.681356 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwf8w\" (UniqueName: \"kubernetes.io/projected/e2b84dc2-3e18-4ff5-ad0d-796ae845fec2-kube-api-access-kwf8w\") pod \"multus-additional-cni-plugins-442lx\" (UID: \"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2\") " pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758372 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-cni-netd\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.760841 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758438 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv2fm\" (UniqueName: \"kubernetes.io/projected/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-kube-api-access-vv2fm\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-systemd-units\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-log-socket\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovnkube-config\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovn-node-metrics-cert\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758518 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-cni-netd\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758528 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-node-log\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758595 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-kubelet\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758620 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-slash\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758662 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-systemd\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-env-overrides\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovnkube-script-lib\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758721 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-systemd-units\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758730 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-log-socket\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758742 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-slash\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.762065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758770 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-systemd\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758785 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-etc-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-etc-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758800 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-kubelet\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758845 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-var-lib-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758869 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758884 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-var-lib-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-cni-bin\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-cni-bin\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-run-netns\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758951 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-node-log\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-ovn\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758980 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-run-netns\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.758948 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-openvswitch\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.759006 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.759032 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-run-ovn\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.759068 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-host-run-ovn-kubernetes\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.759119 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovnkube-config\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.763430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.759166 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-env-overrides\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.764405 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.759421 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovnkube-script-lib\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.764405 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.761655 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-ovn-node-metrics-cert\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.775051 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.774322 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv2fm\" (UniqueName: \"kubernetes.io/projected/d226bb97-0bb0-4fb3-bc5a-f3a9220f9627-kube-api-access-vv2fm\") pod \"ovnkube-node-l8bbk\" (UID: \"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627\") " pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.845460 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.805731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" event={"ID":"2903f8eb788b190a0f3033955eb56b06","Type":"ContainerStarted","Data":"277359e4b959c9bf61614640372ab3392fa9051951d3ad181fe5270706a8e2fd"} Jul 10 14:44:59.845460 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.806952 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" event={"ID":"652befd04fb49fe2d61e157a118a9cc4","Type":"ContainerStarted","Data":"2cf3909a67ac918a2751b55fe036607ab8daf05642d988d36eec961675b63511"} Jul 10 14:44:59.845460 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.843160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" Jul 10 14:44:59.850864 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.850602 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pkv9v" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:59.860105 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d1339c_8a34_4c57_ab6c_6e7b979b5272.slice/crio-bf4d96f639977e85acf46e6ce49b82d8f71a59981abb2b5ffb8e0aa250c73b56 WatchSource:0}: Error finding container bf4d96f639977e85acf46e6ce49b82d8f71a59981abb2b5ffb8e0aa250c73b56: Status 404 returned error can't find the container with id bf4d96f639977e85acf46e6ce49b82d8f71a59981abb2b5ffb8e0aa250c73b56 Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:59.861161 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9adadb8_1cc0_48ab_ad0f_52a587f7abf3.slice/crio-8da0d201e345d2c5403f89cdc931565d8994cdb19b0bfbf5128f6543c9a8618a WatchSource:0}: Error finding container 8da0d201e345d2c5403f89cdc931565d8994cdb19b0bfbf5128f6543c9a8618a: Status 404 returned error can't find the container with id 8da0d201e345d2c5403f89cdc931565d8994cdb19b0bfbf5128f6543c9a8618a Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.862120 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-442lx" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.878145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p9rb8" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.889720 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.890657 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:59.890836 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b84dc2_3e18_4ff5_ad0d_796ae845fec2.slice/crio-b84fc0fcb927d5c6f9c2432fdde5b9ce69d057db595f81b29d74b1c656d00575 WatchSource:0}: Error finding container b84fc0fcb927d5c6f9c2432fdde5b9ce69d057db595f81b29d74b1c656d00575: Status 404 returned error can't find the container with id b84fc0fcb927d5c6f9c2432fdde5b9ce69d057db595f81b29d74b1c656d00575 Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.895664 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.903002 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sbzq6" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.912736 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-spdfh" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:59.914765 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdecfe1c_dd00_4fcb_bd08_84872992e8c1.slice/crio-62c49db9de620830350930fedbd5e6b091cc7e5a3b80cdc05809fd511eeabd15 WatchSource:0}: Error finding container 62c49db9de620830350930fedbd5e6b091cc7e5a3b80cdc05809fd511eeabd15: Status 404 returned error can't find the container with id 62c49db9de620830350930fedbd5e6b091cc7e5a3b80cdc05809fd511eeabd15 Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:44:59.917276 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:59.918395 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b8b1b2_9382_4555_bcc3_b545d705c7c5.slice/crio-2395fdf7f35fb2a3c852bbf6a13f39d95b7c6f8db9f5819eaa3a12c3ad855ad9 WatchSource:0}: Error finding container 2395fdf7f35fb2a3c852bbf6a13f39d95b7c6f8db9f5819eaa3a12c3ad855ad9: Status 404 returned error can't find the container with id 2395fdf7f35fb2a3c852bbf6a13f39d95b7c6f8db9f5819eaa3a12c3ad855ad9 Jul 10 14:44:59.961957 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:44:59.933519 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd226bb97_0bb0_4fb3_bc5a_f3a9220f9627.slice/crio-515ccf577ca01bb8acb2a936711975ecc41c923f171c4067ed17d19e920a0d09 WatchSource:0}: Error finding container 515ccf577ca01bb8acb2a936711975ecc41c923f171c4067ed17d19e920a0d09: Status 404 returned error can't find the container with id 515ccf577ca01bb8acb2a936711975ecc41c923f171c4067ed17d19e920a0d09 Jul 10 14:45:00.198429 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.161492 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:00.198429 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.161527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:00.198429 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.161629 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:00.198429 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.161630 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:00.198429 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.161675 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret podName:cf80ce30-07ad-4e45-988b-735088a856b2 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:01.161662655 +0000 UTC m=+4.028092926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret") pod "global-pull-secret-syncer-hp7mt" (UID: "cf80ce30-07ad-4e45-988b-735088a856b2") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:00.198429 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.161688 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs podName:7c25f2ef-9cec-48f5-9257-84db67d53ff7 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:01.161681864 +0000 UTC m=+4.028112135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs") pod "network-metrics-daemon-cs6cg" (UID: "7c25f2ef-9cec-48f5-9257-84db67d53ff7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:00.441927 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.262475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:00.441927 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.262625 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:45:00.441927 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.262641 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:45:00.441927 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.262653 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7cwsx for pod openshift-network-diagnostics/network-check-target-2pjg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:00.441927 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.262704 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx podName:37bca1ba-3919-4eb0-a9a7-d2bc40dac515 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:01.26268794 +0000 UTC m=+4.129118227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cwsx" (UniqueName: "kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx") pod "network-check-target-2pjg8" (UID: "37bca1ba-3919-4eb0-a9a7-d2bc40dac515") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:00.631445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.615963 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:39:59 +0000 UTC" deadline="2028-03-13 14:42:49.2011812 +0000 UTC" Jul 10 14:45:00.631445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.616003 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14687h57m48.585180786s" Jul 10 14:45:00.801896 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.801867 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:00.802388 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:00.801994 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:00.812340 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.812278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" event={"ID":"31b8b1b2-9382-4555-bcc3-b545d705c7c5","Type":"ContainerStarted","Data":"2395fdf7f35fb2a3c852bbf6a13f39d95b7c6f8db9f5819eaa3a12c3ad855ad9"} Jul 10 14:45:00.813896 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.813871 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9rb8" event={"ID":"fdecfe1c-dd00-4fcb-bd08-84872992e8c1","Type":"ContainerStarted","Data":"62c49db9de620830350930fedbd5e6b091cc7e5a3b80cdc05809fd511eeabd15"} Jul 10 14:45:00.815303 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.815281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerStarted","Data":"b84fc0fcb927d5c6f9c2432fdde5b9ce69d057db595f81b29d74b1c656d00575"} Jul 10 14:45:00.816783 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.816751 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"515ccf577ca01bb8acb2a936711975ecc41c923f171c4067ed17d19e920a0d09"} Jul 10 14:45:00.818177 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.818155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-spdfh" event={"ID":"b9a4ba6f-04fd-400e-b971-3a94cac6ab08","Type":"ContainerStarted","Data":"f3134f07da753bf79eb30efdfa4def5fd1b8601dc2926d72022bbd6a594ff482"} Jul 10 14:45:00.820286 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.820256 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sbzq6" event={"ID":"668c6dc2-cade-4e9a-994f-cc374fdad086","Type":"ContainerStarted","Data":"2b36f335ee1f4e338f94bdae8ed6bc9ba58c55bd7c866413ab066e8e3fc84868"} Jul 10 14:45:00.822579 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.822552 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxz24" event={"ID":"558ec33e-0f35-4c59-8fde-8e2566be2f5e","Type":"ContainerStarted","Data":"de1ae7fcd9e0460a8683e2d0c5679559fab7a8b4c5bdf62ab4c9f319a770909b"} Jul 10 14:45:00.825011 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.824941 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkv9v" event={"ID":"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3","Type":"ContainerStarted","Data":"8da0d201e345d2c5403f89cdc931565d8994cdb19b0bfbf5128f6543c9a8618a"} Jul 10 14:45:00.827009 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:00.826940 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" event={"ID":"06d1339c-8a34-4c57-ab6c-6e7b979b5272","Type":"ContainerStarted","Data":"bf4d96f639977e85acf46e6ce49b82d8f71a59981abb2b5ffb8e0aa250c73b56"} Jul 10 14:45:01.171196 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:01.171160 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:01.171364 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:01.171223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:01.171364 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.171359 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:01.171477 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.171427 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret podName:cf80ce30-07ad-4e45-988b-735088a856b2 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:03.171409869 +0000 UTC m=+6.037840149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret") pod "global-pull-secret-syncer-hp7mt" (UID: "cf80ce30-07ad-4e45-988b-735088a856b2") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:01.171916 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.171811 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:01.171916 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.171879 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs podName:7c25f2ef-9cec-48f5-9257-84db67d53ff7 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:03.171863712 +0000 UTC m=+6.038293989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs") pod "network-metrics-daemon-cs6cg" (UID: "7c25f2ef-9cec-48f5-9257-84db67d53ff7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:01.272155 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:01.271925 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:01.272155 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.272106 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:45:01.272155 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.272124 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:45:01.272155 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.272136 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7cwsx for pod openshift-network-diagnostics/network-check-target-2pjg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:01.272440 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.272183 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx podName:37bca1ba-3919-4eb0-a9a7-d2bc40dac515 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:03.272167929 +0000 UTC m=+6.138598202 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cwsx" (UniqueName: "kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx") pod "network-check-target-2pjg8" (UID: "37bca1ba-3919-4eb0-a9a7-d2bc40dac515") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:01.616453 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:01.616345 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:39:59 +0000 UTC" deadline="2028-01-08 12:30:58.462170891 +0000 UTC" Jul 10 14:45:01.616453 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:01.616380 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13125h45m56.845794903s" Jul 10 14:45:01.803894 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:01.803864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:01.804315 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.804006 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:01.804425 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:01.804384 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:01.804490 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:01.804475 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:02.801852 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:02.801397 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:02.801852 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:02.801746 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:02.854145 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:02.854108 2572 generic.go:356] "Generic (PLEG): container finished" podID="2903f8eb788b190a0f3033955eb56b06" containerID="cd11ab3c00ac4f90f989618ebdd2f2ac850eb0849f6001b97fb2fc388528e4ef" exitCode=0 Jul 10 14:45:02.854564 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:02.854205 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" event={"ID":"2903f8eb788b190a0f3033955eb56b06","Type":"ContainerDied","Data":"cd11ab3c00ac4f90f989618ebdd2f2ac850eb0849f6001b97fb2fc388528e4ef"} Jul 10 14:45:02.860224 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:02.860199 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" event={"ID":"652befd04fb49fe2d61e157a118a9cc4","Type":"ContainerStarted","Data":"566ec6f465425c298510b79b75684e2ec038e18a063881f2d7001fac4f753015"} Jul 10 14:45:02.887184 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:02.887061 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-29.ec2.internal" podStartSLOduration=4.887045707 podStartE2EDuration="4.887045707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:02.88627585 +0000 UTC m=+5.752706145" watchObservedRunningTime="2026-07-10 14:45:02.887045707 +0000 UTC m=+5.753476005" Jul 10 14:45:03.188761 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:03.188674 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:03.188933 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:03.188771 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:03.188933 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.188910 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:03.189053 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.188973 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs podName:7c25f2ef-9cec-48f5-9257-84db67d53ff7 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:07.188953451 +0000 UTC m=+10.055383747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs") pod "network-metrics-daemon-cs6cg" (UID: "7c25f2ef-9cec-48f5-9257-84db67d53ff7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:03.189393 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.189375 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:03.189478 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.189431 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret podName:cf80ce30-07ad-4e45-988b-735088a856b2 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:07.189415471 +0000 UTC m=+10.055845746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret") pod "global-pull-secret-syncer-hp7mt" (UID: "cf80ce30-07ad-4e45-988b-735088a856b2") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:03.289954 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:03.289392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:03.289954 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.289544 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:45:03.289954 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.289561 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:45:03.289954 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.289574 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7cwsx for pod openshift-network-diagnostics/network-check-target-2pjg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:03.289954 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.289629 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx podName:37bca1ba-3919-4eb0-a9a7-d2bc40dac515 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:07.289611573 +0000 UTC m=+10.156041848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cwsx" (UniqueName: "kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx") pod "network-check-target-2pjg8" (UID: "37bca1ba-3919-4eb0-a9a7-d2bc40dac515") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:03.804330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:03.803668 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:03.804330 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.803803 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:03.804330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:03.804174 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:03.804330 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:03.804261 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:04.801278 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:04.801248 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:04.801741 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:04.801402 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:05.802008 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:05.801928 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:05.802433 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:05.801932 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:05.802433 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:05.802067 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:05.802433 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:05.802147 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:06.801184 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:06.801149 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:06.801346 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:06.801280 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:07.217088 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:07.217011 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:07.217088 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:07.217067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:07.217558 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.217170 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:07.217558 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.217247 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs podName:7c25f2ef-9cec-48f5-9257-84db67d53ff7 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:15.217226706 +0000 UTC m=+18.083656983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs") pod "network-metrics-daemon-cs6cg" (UID: "7c25f2ef-9cec-48f5-9257-84db67d53ff7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:07.217558 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.217170 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:07.217558 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.217351 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret podName:cf80ce30-07ad-4e45-988b-735088a856b2 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:15.217331456 +0000 UTC m=+18.083761748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret") pod "global-pull-secret-syncer-hp7mt" (UID: "cf80ce30-07ad-4e45-988b-735088a856b2") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:07.318407 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:07.318281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:07.318562 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.318430 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:45:07.318562 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.318448 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:45:07.318562 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.318459 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7cwsx for pod openshift-network-diagnostics/network-check-target-2pjg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:07.318562 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.318512 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx podName:37bca1ba-3919-4eb0-a9a7-d2bc40dac515 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:15.318495974 +0000 UTC m=+18.184926246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cwsx" (UniqueName: "kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx") pod "network-check-target-2pjg8" (UID: "37bca1ba-3919-4eb0-a9a7-d2bc40dac515") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:07.802674 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:07.802635 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:07.802851 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.802745 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:07.803112 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:07.803095 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:07.803201 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:07.803187 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:08.801723 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:08.801691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:08.802165 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:08.801846 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:09.802040 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:09.802006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:09.802604 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:09.802162 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:09.802604 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:09.802549 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:09.802722 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:09.802644 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:10.803299 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.802886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:10.803299 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:10.802997 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:10.878197 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.877979 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" event={"ID":"31b8b1b2-9382-4555-bcc3-b545d705c7c5","Type":"ContainerStarted","Data":"f8e40e9f7254fd9af2e20de53ecd073f8f6580929a10389acc2bfcbb5187b75d"} Jul 10 14:45:10.883363 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.883335 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" event={"ID":"2903f8eb788b190a0f3033955eb56b06","Type":"ContainerStarted","Data":"14698030efcff0541ef6f2a7a5bf2841075721d7ed14824a2ff9fdd0b1d0ebcc"} Jul 10 14:45:10.887138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.886664 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sbzq6" event={"ID":"668c6dc2-cade-4e9a-994f-cc374fdad086","Type":"ContainerStarted","Data":"f8b556bc559007da5ca29c439afa28c312bae762ac530aae81bf2d368d399b1a"} Jul 10 14:45:10.890179 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.890104 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxz24" event={"ID":"558ec33e-0f35-4c59-8fde-8e2566be2f5e","Type":"ContainerStarted","Data":"6156a6fd5305efcabd5f040c6b6a944b4a8cdd3cf70d9de3f3d012db5da85db1"} Jul 10 14:45:10.893548 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.893524 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" event={"ID":"06d1339c-8a34-4c57-ab6c-6e7b979b5272","Type":"ContainerStarted","Data":"5af3711f8f1b26e5de535afdd24980b1b2a16690c98e6e81ddd66601a6e56397"} Jul 10 14:45:10.901515 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.901471 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kfg2h" podStartSLOduration=2.1969994489999998 podStartE2EDuration="12.901455694s" totalImagesPullingTime="10.704456245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:10.901009661 +0000 UTC m=+13.767439956" watchObservedRunningTime="2026-07-10 14:45:10.901455694 +0000 UTC m=+13.767885989" Jul 10 14:45:10.916969 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.916925 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-29.ec2.internal" podStartSLOduration=12.916908143 podStartE2EDuration="12.916908143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:10.916622576 +0000 UTC m=+13.783052871" watchObservedRunningTime="2026-07-10 14:45:10.916908143 +0000 UTC m=+13.783338438" Jul 10 14:45:10.963706 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.963656 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sbzq6" podStartSLOduration=2.265659372 podStartE2EDuration="12.963638709s" totalImagesPullingTime="10.697979337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:10.963317866 +0000 UTC m=+13.829748175" watchObservedRunningTime="2026-07-10 14:45:10.963638709 +0000 UTC m=+13.830069007" Jul 10 14:45:10.964004 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:10.963968 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hxz24" podStartSLOduration=3.313424188 podStartE2EDuration="13.963958531s" totalImagesPullingTime="10.650534343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:10.935452273 +0000 UTC m=+13.801882567" watchObservedRunningTime="2026-07-10 14:45:10.963958531 +0000 UTC m=+13.830388826" Jul 10 14:45:11.801470 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:11.801390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:11.801594 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:11.801537 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:11.801594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:11.801570 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:11.801692 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:11.801674 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:11.897249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:11.897208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pkv9v" event={"ID":"b9adadb8-1cc0-48ab-ad0f-52a587f7abf3","Type":"ContainerStarted","Data":"bd7a45b9f063dcdefd5e96ba93c54f33744e1b7d29f1d05c6d63c8237a10c4a9"} Jul 10 14:45:11.899306 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:11.899190 2572 generic.go:356] "Generic (PLEG): container finished" podID="e2b84dc2-3e18-4ff5-ad0d-796ae845fec2" containerID="c9a876bb33ecaec1c0db946e0c83fc02c90aace9099513233538dc573426ab55" exitCode=0 Jul 10 14:45:11.899306 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:11.899293 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerDied","Data":"c9a876bb33ecaec1c0db946e0c83fc02c90aace9099513233538dc573426ab55"} Jul 10 14:45:11.913197 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:11.913157 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pkv9v" podStartSLOduration=4.155222084 podStartE2EDuration="14.913141983s" totalImagesPullingTime="10.757919899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:11.912071765 +0000 UTC m=+14.778502060" watchObservedRunningTime="2026-07-10 14:45:11.913141983 +0000 UTC m=+14.779572277" Jul 10 14:45:12.319466 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:12.319388 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:45:12.320043 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:12.320011 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:45:12.801320 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:12.801253 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:12.801466 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:12.801352 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:12.903320 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:12.903275 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p9rb8" event={"ID":"fdecfe1c-dd00-4fcb-bd08-84872992e8c1","Type":"ContainerStarted","Data":"e818089de145963eb2c45f74e1dca1d8286fae11085dc3c0fe50998f4ab49e69"} Jul 10 14:45:12.904157 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:12.904093 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:45:12.904600 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:12.904578 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hxz24" Jul 10 14:45:12.936388 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:12.936339 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p9rb8" podStartSLOduration=5.230546017 podStartE2EDuration="15.936321994s" totalImagesPullingTime="10.705775977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:12.919115596 +0000 UTC m=+15.785545891" watchObservedRunningTime="2026-07-10 14:45:12.936321994 +0000 UTC m=+15.802752289" Jul 10 14:45:13.807173 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:13.807148 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:13.807316 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:13.807254 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:13.807355 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:13.807341 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:13.807455 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:13.807436 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:14.801506 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:14.801467 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:14.802348 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:14.801600 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:15.279357 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:15.279265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:15.279357 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:15.279343 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:15.279526 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.279428 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:15.279526 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.279432 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:15.279526 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.279478 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs podName:7c25f2ef-9cec-48f5-9257-84db67d53ff7 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:31.279464922 +0000 UTC m=+34.145895194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs") pod "network-metrics-daemon-cs6cg" (UID: "7c25f2ef-9cec-48f5-9257-84db67d53ff7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:15.279526 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.279490 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret podName:cf80ce30-07ad-4e45-988b-735088a856b2 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:31.279485034 +0000 UTC m=+34.145915306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret") pod "global-pull-secret-syncer-hp7mt" (UID: "cf80ce30-07ad-4e45-988b-735088a856b2") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:15.380545 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:15.380512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:15.380722 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.380703 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:45:15.380766 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.380732 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:45:15.380766 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.380743 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7cwsx for pod openshift-network-diagnostics/network-check-target-2pjg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:15.380865 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.380798 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx podName:37bca1ba-3919-4eb0-a9a7-d2bc40dac515 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:31.380780042 +0000 UTC m=+34.247210315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cwsx" (UniqueName: "kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx") pod "network-check-target-2pjg8" (UID: "37bca1ba-3919-4eb0-a9a7-d2bc40dac515") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:15.804227 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:15.804065 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:15.804631 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:15.804084 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:15.804631 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.804334 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:15.804631 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:15.804376 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:16.801764 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:16.801730 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:16.801937 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:16.801874 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:17.802253 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:17.802222 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:17.802639 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:17.802319 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:17.802639 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:17.802360 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:17.802639 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:17.802428 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:18.801514 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:18.801479 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:18.801660 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:18.801583 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:19.801469 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:19.801428 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:19.801984 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:19.801570 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:19.801984 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:19.801631 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:19.801984 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:19.801748 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:20.801266 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:20.801198 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:20.801441 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:20.801396 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:21.801090 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:21.801064 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:21.801628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:21.801065 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:21.801628 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:21.801172 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:21.801628 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:21.801266 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:22.287115 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.287081 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 14:45:22.629244 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.629170 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T14:45:22.287100868Z","UUID":"cf4940d2-fbf9-4c02-bc3a-32e544f63193","Handler":null,"Name":"","Endpoint":""} Jul 10 14:45:22.630593 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.630571 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 14:45:22.630671 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.630619 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 14:45:22.801234 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.801145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:22.801756 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:22.801259 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:22.925561 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.925507 2572 generic.go:356] "Generic (PLEG): container finished" podID="e2b84dc2-3e18-4ff5-ad0d-796ae845fec2" containerID="de8fcb96a6844a6f06b7094e51ec039233abd84259c26ec38ac4758f84751629" exitCode=0 Jul 10 14:45:22.925663 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.925588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerDied","Data":"de8fcb96a6844a6f06b7094e51ec039233abd84259c26ec38ac4758f84751629"} Jul 10 14:45:22.928542 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.928524 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:45:22.928940 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.928920 2572 generic.go:356] "Generic (PLEG): container finished" podID="d226bb97-0bb0-4fb3-bc5a-f3a9220f9627" containerID="2a479a63fe518be2953a17c8ef6f32232d801ce24c02d1509a567b5efafefc02" exitCode=1 Jul 10 14:45:22.929029 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.928989 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"d701517c221953666f88ab94e30f95f7711039ac18ea07a3154fe7fe876e4186"} Jul 10 14:45:22.929085 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.929058 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"51ec94155dbabd2d05b4b3aeeba948e5c75fc08564eb84ba980128832ed03410"} Jul 10 14:45:22.929132 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.929094 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"dc8159d76f48ead00adaff48229135b16eb19aea4c9fed95c5a64ae46cbc0058"} Jul 10 14:45:22.929132 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.929122 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"960ba32ba6762949c6947397f0370713e62fe7ad8d712c42f80eb223f4feb59d"} Jul 10 14:45:22.929235 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.929155 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerDied","Data":"2a479a63fe518be2953a17c8ef6f32232d801ce24c02d1509a567b5efafefc02"} Jul 10 14:45:22.929235 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.929189 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"b00c3a430e0732d5da8f6c137e208bf3e21c0387cd22b5c855985f6f73b338ba"} Jul 10 14:45:22.930671 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.930647 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-spdfh" event={"ID":"b9a4ba6f-04fd-400e-b971-3a94cac6ab08","Type":"ContainerStarted","Data":"9251d4edabca1bffe3067da368cc9ec2245ad3d5a46fc4ae77c611ebc8b98983"} Jul 10 14:45:22.932577 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.932553 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" event={"ID":"06d1339c-8a34-4c57-ab6c-6e7b979b5272","Type":"ContainerStarted","Data":"9be70078200f02ff6e339f01c7feb84e93ec327bd22d8f3a517c1dec86616b45"} Jul 10 14:45:22.985221 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:22.985185 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-spdfh" podStartSLOduration=2.74916918 podStartE2EDuration="24.985169237s" totalImagesPullingTime="22.236000057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:22.985095742 +0000 UTC m=+25.851526036" watchObservedRunningTime="2026-07-10 14:45:22.985169237 +0000 UTC m=+25.851599532" Jul 10 14:45:23.801757 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:23.801734 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:23.802123 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:23.801774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:23.802178 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:23.801874 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:23.802235 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:23.802207 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:23.936707 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:23.936623 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" event={"ID":"06d1339c-8a34-4c57-ab6c-6e7b979b5272","Type":"ContainerStarted","Data":"55eaa0a8dfb57746e090ff82b451f8a6704376202cea371922575c1644e88667"} Jul 10 14:45:23.957571 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:23.957531 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnsw2" podStartSLOduration=5.178806321 podStartE2EDuration="26.957512819s" totalImagesPullingTime="21.778706498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:23.956207065 +0000 UTC m=+26.822637359" watchObservedRunningTime="2026-07-10 14:45:23.957512819 +0000 UTC m=+26.823943125" Jul 10 14:45:24.801649 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:24.801627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:24.801814 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:24.801725 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:24.940287 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:24.940260 2572 generic.go:356] "Generic (PLEG): container finished" podID="e2b84dc2-3e18-4ff5-ad0d-796ae845fec2" containerID="38be95b18cf6add4713d35409347ae4a3c8b5e0925264f764e42c7507209b4eb" exitCode=0 Jul 10 14:45:24.940402 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:24.940346 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerDied","Data":"38be95b18cf6add4713d35409347ae4a3c8b5e0925264f764e42c7507209b4eb"} Jul 10 14:45:25.801393 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:25.801361 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:25.801545 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:25.801490 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:25.801596 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:25.801538 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:25.801645 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:25.801629 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:25.944635 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:25.944608 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:45:25.945098 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:25.944944 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"6347b962108f60c29d94d8ebcdf855578ebec7af1ca65fc09d01cbb1730c5b42"} Jul 10 14:45:26.801165 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:26.801137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:26.801299 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:26.801221 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:26.951960 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:26.951909 2572 generic.go:356] "Generic (PLEG): container finished" podID="e2b84dc2-3e18-4ff5-ad0d-796ae845fec2" containerID="59f8a8a53ea4869291cb1991853fee8018a72777f75e2370dc924c6c1100b422" exitCode=0 Jul 10 14:45:26.951960 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:26.951939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerDied","Data":"59f8a8a53ea4869291cb1991853fee8018a72777f75e2370dc924c6c1100b422"} Jul 10 14:45:27.801952 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.801743 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:27.802148 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.801840 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:27.802148 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:27.802048 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:27.802148 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:27.802109 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:27.958443 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.958412 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:45:27.958941 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.958788 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"f7c6a5e1ef7978e1346987cb500a4b57ce672c4dee8741d26769d81d0f3d13ad"} Jul 10 14:45:27.959048 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.959016 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:45:27.959108 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.959092 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:45:27.959155 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.959124 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:45:27.959304 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.959286 2572 scope.go:117] "RemoveContainer" containerID="2a479a63fe518be2953a17c8ef6f32232d801ce24c02d1509a567b5efafefc02" Jul 10 14:45:27.977456 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.977434 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:45:27.977810 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:27.977789 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:45:28.801297 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:28.801263 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:28.801432 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:28.801407 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:28.966324 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:28.966297 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:45:28.966803 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:28.966766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" event={"ID":"d226bb97-0bb0-4fb3-bc5a-f3a9220f9627","Type":"ContainerStarted","Data":"4e7709bf1286fba1fc0b4b86bf98f01151b3e8f5d53430866082f449a94c922f"} Jul 10 14:45:29.018874 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:29.018803 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" podStartSLOduration=8.78760772 podStartE2EDuration="31.018787138s" totalImagesPullingTime="22.231179418s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:29.016638245 +0000 UTC m=+31.883068563" watchObservedRunningTime="2026-07-10 14:45:29.018787138 +0000 UTC m=+31.885217432" Jul 10 14:45:29.281765 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:29.281692 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2pjg8"] Jul 10 14:45:29.281937 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:29.281800 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:29.281937 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:29.281915 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:29.288223 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:29.288195 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hp7mt"] Jul 10 14:45:29.288504 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:29.288473 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:29.288659 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:29.288622 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:29.294563 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:29.294537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cs6cg"] Jul 10 14:45:29.294659 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:29.294647 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:29.294767 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:29.294746 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:30.801445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:30.801410 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:30.801445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:30.801442 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:30.801909 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:30.801451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:30.801909 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:30.801527 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:30.801909 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:30.801604 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:30.801909 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:30.801677 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:31.295713 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:31.295679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:31.295860 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:31.295730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:31.295921 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.295861 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:31.295921 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.295875 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:31.295999 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.295926 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret podName:cf80ce30-07ad-4e45-988b-735088a856b2 nodeName:}" failed. No retries permitted until 2026-07-10 14:46:03.295909966 +0000 UTC m=+66.162340243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret") pod "global-pull-secret-syncer-hp7mt" (UID: "cf80ce30-07ad-4e45-988b-735088a856b2") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:45:31.295999 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.295945 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs podName:7c25f2ef-9cec-48f5-9257-84db67d53ff7 nodeName:}" failed. No retries permitted until 2026-07-10 14:46:03.295936382 +0000 UTC m=+66.162366657 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs") pod "network-metrics-daemon-cs6cg" (UID: "7c25f2ef-9cec-48f5-9257-84db67d53ff7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:45:31.396157 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:31.396128 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:31.396327 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.396308 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:45:31.396406 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.396337 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:45:31.396406 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.396350 2572 projected.go:196] Error preparing data for projected volume kube-api-access-7cwsx for pod openshift-network-diagnostics/network-check-target-2pjg8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:31.396502 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:31.396409 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx podName:37bca1ba-3919-4eb0-a9a7-d2bc40dac515 nodeName:}" failed. No retries permitted until 2026-07-10 14:46:03.396390402 +0000 UTC m=+66.262820691 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7cwsx" (UniqueName: "kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx") pod "network-check-target-2pjg8" (UID: "37bca1ba-3919-4eb0-a9a7-d2bc40dac515") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:45:32.801728 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:32.801699 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:32.802297 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:32.801704 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:32.802297 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:32.801803 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:32.802297 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:32.801911 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:32.802297 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:32.801704 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:32.802297 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:32.802021 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:32.978963 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:32.978936 2572 generic.go:356] "Generic (PLEG): container finished" podID="e2b84dc2-3e18-4ff5-ad0d-796ae845fec2" containerID="2a922ceb1eb089f5b269e08c252d56f25d108e1c8182a44b25302121d0573287" exitCode=0 Jul 10 14:45:32.979080 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:32.978967 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerDied","Data":"2a922ceb1eb089f5b269e08c252d56f25d108e1c8182a44b25302121d0573287"} Jul 10 14:45:33.984319 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:33.984285 2572 generic.go:356] "Generic (PLEG): container finished" podID="e2b84dc2-3e18-4ff5-ad0d-796ae845fec2" containerID="b84f43e512d0bdd7641b2c01405fd1e4c9d83b49c1c55ed47114cde85a839843" exitCode=0 Jul 10 14:45:33.984319 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:33.984321 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerDied","Data":"b84f43e512d0bdd7641b2c01405fd1e4c9d83b49c1c55ed47114cde85a839843"} Jul 10 14:45:34.801369 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.801344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:34.801467 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.801348 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:34.801467 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:34.801434 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hp7mt" podUID="cf80ce30-07ad-4e45-988b-735088a856b2" Jul 10 14:45:34.801527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.801351 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:34.801570 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:34.801522 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cs6cg" podUID="7c25f2ef-9cec-48f5-9257-84db67d53ff7" Jul 10 14:45:34.801612 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:34.801596 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2pjg8" podUID="37bca1ba-3919-4eb0-a9a7-d2bc40dac515" Jul 10 14:45:34.878222 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.878173 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-29.ec2.internal" event="NodeReady" Jul 10 14:45:34.878301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.878252 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 14:45:34.933324 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.933304 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh"] Jul 10 14:45:34.945391 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.945374 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57f4976748-f5s4v"] Jul 10 14:45:34.945491 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.945476 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:34.950809 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.950786 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 14:45:34.952122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.952088 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 14:45:34.952220 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.952136 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 14:45:34.952220 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.952136 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6t2vj\"" Jul 10 14:45:34.952220 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.952140 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 14:45:34.954704 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.954688 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8664978b5b-jvc8t"] Jul 10 14:45:34.954801 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.954791 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:34.961770 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.961748 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 14:45:34.961988 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.961972 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 14:45:34.961988 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.961983 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 14:45:34.962111 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.962083 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 14:45:34.962111 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.962084 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 14:45:34.962206 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.962110 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 14:45:34.962206 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.962135 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7rkvf\"" Jul 10 14:45:34.965684 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.965668 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz"] Jul 10 14:45:34.965813 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.965794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:34.968330 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.968310 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 14:45:34.968962 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.968946 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 14:45:34.969093 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.969077 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xlk8t\"" Jul 10 14:45:34.970379 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.970362 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 14:45:34.976200 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.976180 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 14:45:34.981574 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.981554 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8"] Jul 10 14:45:34.981669 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.981655 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:34.987281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.987155 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nlvkb\"" Jul 10 14:45:34.987775 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.987756 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:45:34.988203 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.988019 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 14:45:34.988574 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.988555 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 14:45:34.995785 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.994554 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-442lx" event={"ID":"e2b84dc2-3e18-4ff5-ad0d-796ae845fec2","Type":"ContainerStarted","Data":"125cb7a190020543826c3a748f7285c8779aef21d5f42bfb6ca4c6c46e5ca84e"} Jul 10 14:45:34.995785 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.994598 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5"] Jul 10 14:45:34.995785 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.994706 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" Jul 10 14:45:34.998120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.998101 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 10 14:45:34.998354 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.998332 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-rrvqn\"" Jul 10 14:45:34.998447 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:34.998357 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:45:35.005996 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.005978 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9"] Jul 10 14:45:35.006091 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.006077 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.010242 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.010224 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 14:45:35.010552 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.010533 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k7fbr\"" Jul 10 14:45:35.010552 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.010548 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 14:45:35.010792 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.010776 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 14:45:35.010792 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.010782 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:45:35.021069 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.021048 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fgr4v"] Jul 10 14:45:35.021174 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.021139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.021174 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.021154 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.021281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.021188 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.021281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.021207 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpvxn\" (UniqueName: \"kubernetes.io/projected/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-kube-api-access-zpvxn\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.025239 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.025214 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 14:45:35.025239 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.025229 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 14:45:35.025402 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.025214 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 14:45:35.025856 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.025790 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-d7kls\"" Jul 10 14:45:35.026998 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.026882 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:45:35.032054 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.032037 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-mxf5k"] Jul 10 14:45:35.032152 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.032139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.034254 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.034233 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 10 14:45:35.034931 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.034918 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nqg8v\"" Jul 10 14:45:35.035167 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.035153 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 10 14:45:35.035236 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.035184 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 14:45:35.035236 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.035202 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 14:45:35.043849 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.043808 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 10 14:45:35.047167 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.047146 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh"] Jul 10 14:45:35.047248 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.047175 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt"] Jul 10 14:45:35.047305 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.047269 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.050481 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.050463 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 10 14:45:35.050581 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.050502 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:45:35.051060 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.051040 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5bh8n\"" Jul 10 14:45:35.054263 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.054242 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 10 14:45:35.054419 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.054404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 10 14:45:35.056527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056509 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz"] Jul 10 14:45:35.056594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056546 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57f4976748-f5s4v"] Jul 10 14:45:35.056594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056584 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mxf5k"] Jul 10 14:45:35.056663 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056642 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9"] Jul 10 14:45:35.056693 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056666 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8664978b5b-jvc8t"] Jul 10 14:45:35.056693 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056679 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" Jul 10 14:45:35.056752 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056695 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fgr4v"] Jul 10 14:45:35.056752 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056718 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8"] Jul 10 14:45:35.056752 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056735 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5"] Jul 10 14:45:35.056927 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.056781 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5v76q"] Jul 10 14:45:35.060141 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.060126 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 14:45:35.060237 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.060214 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 14:45:35.060527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.060512 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gtffp\"" Jul 10 14:45:35.061850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.061836 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 10 14:45:35.069555 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.069540 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dvjhp"] Jul 10 14:45:35.069661 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.069648 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.072453 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.072436 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqvz7\"" Jul 10 14:45:35.072453 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.072447 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 14:45:35.072669 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.072655 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 14:45:35.084563 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.084546 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt"] Jul 10 14:45:35.084637 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.084592 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dvjhp"] Jul 10 14:45:35.084637 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.084616 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5v76q"] Jul 10 14:45:35.084717 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.084678 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.087715 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.087700 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 14:45:35.088273 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.088258 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zqj22\"" Jul 10 14:45:35.088361 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.088290 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 14:45:35.088361 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.088314 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 14:45:35.114919 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.114880 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-442lx" podStartSLOduration=9.391653258 podStartE2EDuration="38.114867618s" totalImagesPullingTime="28.72321436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:35.114641901 +0000 UTC m=+37.981072195" watchObservedRunningTime="2026-07-10 14:45:35.114867618 +0000 UTC m=+37.981297911" Jul 10 14:45:35.121981 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.121958 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6bwq\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-kube-api-access-l6bwq\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.122075 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.121985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-image-registry-private-configuration\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.122075 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122002 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-installation-pull-secrets\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.122075 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122019 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvkvw\" (UniqueName: \"kubernetes.io/projected/29b0f027-562f-459a-aec1-d732891582e8-kube-api-access-jvkvw\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.122075 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtm29\" (UniqueName: \"kubernetes.io/projected/30e3b9c0-db77-49c9-a18f-6acf08199234-kube-api-access-gtm29\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:35.122208 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122073 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2k7d\" (UniqueName: \"kubernetes.io/projected/dd5ada5a-d874-4cd9-89a7-ca7c73126866-kube-api-access-b2k7d\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.122208 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:35.122208 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122124 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pnsf\" (UniqueName: \"kubernetes.io/projected/7b37164e-7bef-4517-a76b-8bdd9c8b4e71-kube-api-access-9pnsf\") pod \"volume-data-source-validator-78495597f6-tn9g8\" (UID: \"7b37164e-7bef-4517-a76b-8bdd9c8b4e71\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" Jul 10 14:45:35.122208 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122158 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpsvf\" (UniqueName: \"kubernetes.io/projected/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-kube-api-access-wpsvf\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.122208 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122178 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29b0f027-562f-459a-aec1-d732891582e8-serving-cert\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.122351 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122208 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.122351 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122226 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-default-certificate\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.122351 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-snapshots\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.122351 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39a791a9-9f83-40a1-af78-f63ebea452b6-trusted-ca\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.122351 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.122351 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122326 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-trusted-ca\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.122351 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.122350 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:35.122604 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122352 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39a791a9-9f83-40a1-af78-f63ebea452b6-config\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.122604 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.122415 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls podName:d3d58457-f9df-4a93-b5a0-a20802e2b9cf nodeName:}" failed. No retries permitted until 2026-07-10 14:45:35.622397124 +0000 UTC m=+38.488827404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bw5sh" (UID: "d3d58457-f9df-4a93-b5a0-a20802e2b9cf") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:35.122604 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122497 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6r9c\" (UniqueName: \"kubernetes.io/projected/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-kube-api-access-t6r9c\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.122604 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122544 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.122815 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.122815 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122629 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29b0f027-562f-459a-aec1-d732891582e8-config\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.122815 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fee07384-d124-4723-a25c-db8c46b1064f-ca-trust-extracted\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.122815 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122673 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-tmp\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.122815 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122764 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-stats-auth\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.122815 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122807 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpvxn\" (UniqueName: \"kubernetes.io/projected/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-kube-api-access-zpvxn\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-serving-cert\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd5ada5a-d874-4cd9-89a7-ca7c73126866-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-bound-sa-token\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a791a9-9f83-40a1-af78-f63ebea452b6-serving-cert\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122982 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd5ada5a-d874-4cd9-89a7-ca7c73126866-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.122998 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnbxt\" (UniqueName: \"kubernetes.io/projected/39a791a9-9f83-40a1-af78-f63ebea452b6-kube-api-access-pnbxt\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.123035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.123055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-registry-certificates\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.123153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.123072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.123528 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.123349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.136217 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.136169 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpvxn\" (UniqueName: \"kubernetes.io/projected/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-kube-api-access-zpvxn\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.181200 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.181181 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:35.223957 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.223933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-serving-cert\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.224044 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.223960 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd5ada5a-d874-4cd9-89a7-ca7c73126866-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.224044 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.223978 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.224044 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.223992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-bound-sa-token\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.224044 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224010 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a791a9-9f83-40a1-af78-f63ebea452b6-serving-cert\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.224044 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224033 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd5ada5a-d874-4cd9-89a7-ca7c73126866-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.224281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224058 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnbxt\" (UniqueName: \"kubernetes.io/projected/39a791a9-9f83-40a1-af78-f63ebea452b6-kube-api-access-pnbxt\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.224281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvbgs\" (UniqueName: \"kubernetes.io/projected/6459c64f-420e-4b7f-ba05-c6b347b135e5-kube-api-access-nvbgs\") pod \"ingress-canary-dvjhp\" (UID: \"6459c64f-420e-4b7f-ba05-c6b347b135e5\") " pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.224281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224266 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.224431 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-registry-certificates\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.224431 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.224431 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.224345 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:45:35.224431 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224349 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mczl\" (UniqueName: \"kubernetes.io/projected/0f7278e3-9957-4dc1-8155-7fd34da42fba-kube-api-access-7mczl\") pod \"network-check-source-869dcfcdcd-n48nt\" (UID: \"0f7278e3-9957-4dc1-8155-7fd34da42fba\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" Jul 10 14:45:35.224431 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxv7v\" (UniqueName: \"kubernetes.io/projected/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-kube-api-access-dxv7v\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.224431 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.224404 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:35.724387896 +0000 UTC m=+38.590818183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : secret "router-metrics-certs-default" not found Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224435 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6bwq\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-kube-api-access-l6bwq\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-image-registry-private-configuration\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-installation-pull-secrets\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvkvw\" (UniqueName: \"kubernetes.io/projected/29b0f027-562f-459a-aec1-d732891582e8-kube-api-access-jvkvw\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtm29\" (UniqueName: \"kubernetes.io/projected/30e3b9c0-db77-49c9-a18f-6acf08199234-kube-api-access-gtm29\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2k7d\" (UniqueName: \"kubernetes.io/projected/dd5ada5a-d874-4cd9-89a7-ca7c73126866-kube-api-access-b2k7d\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224578 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dd5ada5a-d874-4cd9-89a7-ca7c73126866-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224591 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-tmp-dir\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pnsf\" (UniqueName: \"kubernetes.io/projected/7b37164e-7bef-4517-a76b-8bdd9c8b4e71-kube-api-access-9pnsf\") pod \"volume-data-source-validator-78495597f6-tn9g8\" (UID: \"7b37164e-7bef-4517-a76b-8bdd9c8b4e71\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpsvf\" (UniqueName: \"kubernetes.io/projected/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-kube-api-access-wpsvf\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.224741 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224736 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29b0f027-562f-459a-aec1-d732891582e8-serving-cert\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-default-certificate\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-snapshots\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39a791a9-9f83-40a1-af78-f63ebea452b6-trusted-ca\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.224900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225217 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-trusted-ca\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39a791a9-9f83-40a1-af78-f63ebea452b6-config\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6459c64f-420e-4b7f-ba05-c6b347b135e5-cert\") pod \"ingress-canary-dvjhp\" (UID: \"6459c64f-420e-4b7f-ba05-c6b347b135e5\") " pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225327 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6r9c\" (UniqueName: \"kubernetes.io/projected/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-kube-api-access-t6r9c\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-config-volume\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29b0f027-562f-459a-aec1-d732891582e8-config\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225416 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.225449 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fee07384-d124-4723-a25c-db8c46b1064f-ca-trust-extracted\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.226085 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-tmp\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.226085 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-stats-auth\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.226085 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.225507 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:45:35.226085 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.225566 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls podName:30e3b9c0-db77-49c9-a18f-6acf08199234 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:35.725546141 +0000 UTC m=+38.591976420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls") pod "cluster-samples-operator-65db858894-p2kfz" (UID: "30e3b9c0-db77-49c9-a18f-6acf08199234") : secret "samples-operator-tls" not found Jul 10 14:45:35.226085 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225608 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-snapshots\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.226343 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225012 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-registry-certificates\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.226551 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.226535 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:45:35.226648 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.226637 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8664978b5b-jvc8t: secret "image-registry-tls" not found Jul 10 14:45:35.227113 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.227100 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls podName:fee07384-d124-4723-a25c-db8c46b1064f nodeName:}" failed. No retries permitted until 2026-07-10 14:45:35.727083184 +0000 UTC m=+38.593513473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls") pod "image-registry-8664978b5b-jvc8t" (UID: "fee07384-d124-4723-a25c-db8c46b1064f") : secret "image-registry-tls" not found Jul 10 14:45:35.227232 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.226637 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/39a791a9-9f83-40a1-af78-f63ebea452b6-trusted-ca\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.227911 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.227444 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/39a791a9-9f83-40a1-af78-f63ebea452b6-config\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.227911 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.225027 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.227911 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.227583 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:35.727568933 +0000 UTC m=+38.593999222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : configmap references non-existent config key: service-ca.crt Jul 10 14:45:35.227911 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.227654 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd5ada5a-d874-4cd9-89a7-ca7c73126866-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.227911 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.227680 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a791a9-9f83-40a1-af78-f63ebea452b6-serving-cert\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.228408 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228330 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29b0f027-562f-459a-aec1-d732891582e8-config\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.228408 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fee07384-d124-4723-a25c-db8c46b1064f-ca-trust-extracted\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.228408 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228378 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-serving-cert\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.228587 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228428 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-default-certificate\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.228587 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228575 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-tmp\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.228929 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228899 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-installation-pull-secrets\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.229015 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228948 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-trusted-ca\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.229015 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.228978 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29b0f027-562f-459a-aec1-d732891582e8-serving-cert\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.229015 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.229005 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-stats-auth\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.229757 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.229736 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-image-registry-private-configuration\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.238285 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.238265 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnbxt\" (UniqueName: \"kubernetes.io/projected/39a791a9-9f83-40a1-af78-f63ebea452b6-kube-api-access-pnbxt\") pod \"console-operator-7866497494-mxf5k\" (UID: \"39a791a9-9f83-40a1-af78-f63ebea452b6\") " pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.238863 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.238841 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pnsf\" (UniqueName: \"kubernetes.io/projected/7b37164e-7bef-4517-a76b-8bdd9c8b4e71-kube-api-access-9pnsf\") pod \"volume-data-source-validator-78495597f6-tn9g8\" (UID: \"7b37164e-7bef-4517-a76b-8bdd9c8b4e71\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" Jul 10 14:45:35.240076 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.240055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-bound-sa-token\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.247135 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.247116 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6r9c\" (UniqueName: \"kubernetes.io/projected/1d032ff4-1c76-47a0-8299-8dfa58ca6bf8-kube-api-access-t6r9c\") pod \"insights-operator-68d9dd94cf-fgr4v\" (UID: \"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8\") " pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.253457 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.253437 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvkvw\" (UniqueName: \"kubernetes.io/projected/29b0f027-562f-459a-aec1-d732891582e8-kube-api-access-jvkvw\") pod \"service-ca-operator-7695fc6c8c-vn2c5\" (UID: \"29b0f027-562f-459a-aec1-d732891582e8\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.254982 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.254954 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2k7d\" (UniqueName: \"kubernetes.io/projected/dd5ada5a-d874-4cd9-89a7-ca7c73126866-kube-api-access-b2k7d\") pod \"kube-storage-version-migrator-operator-799cb7f958-dlls9\" (UID: \"dd5ada5a-d874-4cd9-89a7-ca7c73126866\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.255131 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.255115 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtm29\" (UniqueName: \"kubernetes.io/projected/30e3b9c0-db77-49c9-a18f-6acf08199234-kube-api-access-gtm29\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:35.256859 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.256841 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpsvf\" (UniqueName: \"kubernetes.io/projected/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-kube-api-access-wpsvf\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.258526 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.258508 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6bwq\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-kube-api-access-l6bwq\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.303625 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.303605 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" Jul 10 14:45:35.314028 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.314013 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" Jul 10 14:45:35.325803 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.325778 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvbgs\" (UniqueName: \"kubernetes.io/projected/6459c64f-420e-4b7f-ba05-c6b347b135e5-kube-api-access-nvbgs\") pod \"ingress-canary-dvjhp\" (UID: \"6459c64f-420e-4b7f-ba05-c6b347b135e5\") " pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.325913 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.325854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mczl\" (UniqueName: \"kubernetes.io/projected/0f7278e3-9957-4dc1-8155-7fd34da42fba-kube-api-access-7mczl\") pod \"network-check-source-869dcfcdcd-n48nt\" (UID: \"0f7278e3-9957-4dc1-8155-7fd34da42fba\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" Jul 10 14:45:35.325913 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.325883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxv7v\" (UniqueName: \"kubernetes.io/projected/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-kube-api-access-dxv7v\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.325985 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.325944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-tmp-dir\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.325985 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.325969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.326115 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.326096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6459c64f-420e-4b7f-ba05-c6b347b135e5-cert\") pod \"ingress-canary-dvjhp\" (UID: \"6459c64f-420e-4b7f-ba05-c6b347b135e5\") " pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.326222 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.326123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-config-volume\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.326222 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.326156 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:45:35.326222 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.326209 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls podName:16d26c4e-bf87-4cb7-bf2f-b317d5500cc4 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:35.826193122 +0000 UTC m=+38.692623405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls") pod "dns-default-5v76q" (UID: "16d26c4e-bf87-4cb7-bf2f-b317d5500cc4") : secret "dns-default-metrics-tls" not found Jul 10 14:45:35.326465 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.326282 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-tmp-dir\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.326666 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.326645 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-config-volume\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.328600 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.328578 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6459c64f-420e-4b7f-ba05-c6b347b135e5-cert\") pod \"ingress-canary-dvjhp\" (UID: \"6459c64f-420e-4b7f-ba05-c6b347b135e5\") " pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.331967 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.331873 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" Jul 10 14:45:35.338300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.338279 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxv7v\" (UniqueName: \"kubernetes.io/projected/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-kube-api-access-dxv7v\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.338401 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.338378 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mczl\" (UniqueName: \"kubernetes.io/projected/0f7278e3-9957-4dc1-8155-7fd34da42fba-kube-api-access-7mczl\") pod \"network-check-source-869dcfcdcd-n48nt\" (UID: \"0f7278e3-9957-4dc1-8155-7fd34da42fba\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" Jul 10 14:45:35.339476 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.339459 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvbgs\" (UniqueName: \"kubernetes.io/projected/6459c64f-420e-4b7f-ba05-c6b347b135e5-kube-api-access-nvbgs\") pod \"ingress-canary-dvjhp\" (UID: \"6459c64f-420e-4b7f-ba05-c6b347b135e5\") " pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.340234 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.340212 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" Jul 10 14:45:35.344393 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.344359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:35.355583 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.355537 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:35.364014 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.363978 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" Jul 10 14:45:35.396212 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.395933 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dvjhp" Jul 10 14:45:35.427750 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.427227 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:35.514127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.513971 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8"] Jul 10 14:45:35.526981 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.526767 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5"] Jul 10 14:45:35.568777 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.568459 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9"] Jul 10 14:45:35.591860 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.591837 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-fgr4v"] Jul 10 14:45:35.595588 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:45:35.595563 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d032ff4_1c76_47a0_8299_8dfa58ca6bf8.slice/crio-f15f7bd7d16eee431b1cf1454e2423cdd689a17b11b4b2ff65ab1fc8a3afbb95 WatchSource:0}: Error finding container f15f7bd7d16eee431b1cf1454e2423cdd689a17b11b4b2ff65ab1fc8a3afbb95: Status 404 returned error can't find the container with id f15f7bd7d16eee431b1cf1454e2423cdd689a17b11b4b2ff65ab1fc8a3afbb95 Jul 10 14:45:35.617871 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.617849 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mxf5k"] Jul 10 14:45:35.621552 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:45:35.621529 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a791a9_9f83_40a1_af78_f63ebea452b6.slice/crio-9c9849fd3d5ae0e456589c9d1fbc7b85ac1467b1ced0cdf6df53fa5037e383b9 WatchSource:0}: Error finding container 9c9849fd3d5ae0e456589c9d1fbc7b85ac1467b1ced0cdf6df53fa5037e383b9: Status 404 returned error can't find the container with id 9c9849fd3d5ae0e456589c9d1fbc7b85ac1467b1ced0cdf6df53fa5037e383b9 Jul 10 14:45:35.627233 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.627211 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dvjhp"] Jul 10 14:45:35.628583 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.628559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:35.628715 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.628698 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:35.628775 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.628767 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls podName:d3d58457-f9df-4a93-b5a0-a20802e2b9cf nodeName:}" failed. No retries permitted until 2026-07-10 14:45:36.628744632 +0000 UTC m=+39.495174921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bw5sh" (UID: "d3d58457-f9df-4a93-b5a0-a20802e2b9cf") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:35.630165 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:45:35.630144 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6459c64f_420e_4b7f_ba05_c6b347b135e5.slice/crio-4b0e2340dd440451e31d7e7d14e65e454b62312a668f8010232ae01c38ad138a WatchSource:0}: Error finding container 4b0e2340dd440451e31d7e7d14e65e454b62312a668f8010232ae01c38ad138a: Status 404 returned error can't find the container with id 4b0e2340dd440451e31d7e7d14e65e454b62312a668f8010232ae01c38ad138a Jul 10 14:45:35.638116 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.638098 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt"] Jul 10 14:45:35.639850 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:45:35.639812 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7278e3_9957_4dc1_8155_7fd34da42fba.slice/crio-df219b761f4e3e6a160787c8ec68d9d61c76544fd15ae2a9beb33d76a52fa1fd WatchSource:0}: Error finding container df219b761f4e3e6a160787c8ec68d9d61c76544fd15ae2a9beb33d76a52fa1fd: Status 404 returned error can't find the container with id df219b761f4e3e6a160787c8ec68d9d61c76544fd15ae2a9beb33d76a52fa1fd Jul 10 14:45:35.729353 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.729330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.729446 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.729379 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:35.729491 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729477 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:45:35.729491 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729477 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:45:35.729550 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729530 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:36.729510102 +0000 UTC m=+39.595940390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : secret "router-metrics-certs-default" not found Jul 10 14:45:35.729550 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729544 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls podName:30e3b9c0-db77-49c9-a18f-6acf08199234 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:36.729537789 +0000 UTC m=+39.595968060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls") pod "cluster-samples-operator-65db858894-p2kfz" (UID: "30e3b9c0-db77-49c9-a18f-6acf08199234") : secret "samples-operator-tls" not found Jul 10 14:45:35.729614 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.729585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:35.729648 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.729622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:35.729727 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729714 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:45:35.729760 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729728 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:36.729717353 +0000 UTC m=+39.596147641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : configmap references non-existent config key: service-ca.crt Jul 10 14:45:35.729760 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729731 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8664978b5b-jvc8t: secret "image-registry-tls" not found Jul 10 14:45:35.729842 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.729762 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls podName:fee07384-d124-4723-a25c-db8c46b1064f nodeName:}" failed. No retries permitted until 2026-07-10 14:45:36.729754528 +0000 UTC m=+39.596184803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls") pod "image-registry-8664978b5b-jvc8t" (UID: "fee07384-d124-4723-a25c-db8c46b1064f") : secret "image-registry-tls" not found Jul 10 14:45:35.830041 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.830016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:35.830130 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.830118 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:45:35.830177 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:35.830164 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls podName:16d26c4e-bf87-4cb7-bf2f-b317d5500cc4 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:36.830153436 +0000 UTC m=+39.696583708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls") pod "dns-default-5v76q" (UID: "16d26c4e-bf87-4cb7-bf2f-b317d5500cc4") : secret "dns-default-metrics-tls" not found Jul 10 14:45:35.994670 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.994617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" event={"ID":"0f7278e3-9957-4dc1-8155-7fd34da42fba","Type":"ContainerStarted","Data":"df219b761f4e3e6a160787c8ec68d9d61c76544fd15ae2a9beb33d76a52fa1fd"} Jul 10 14:45:35.995627 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.995607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxf5k" event={"ID":"39a791a9-9f83-40a1-af78-f63ebea452b6","Type":"ContainerStarted","Data":"9c9849fd3d5ae0e456589c9d1fbc7b85ac1467b1ced0cdf6df53fa5037e383b9"} Jul 10 14:45:35.996830 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.996793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" event={"ID":"dd5ada5a-d874-4cd9-89a7-ca7c73126866","Type":"ContainerStarted","Data":"1e5e67af90ebbbac4f55cd671b97feb09fcaac0ef77e9cd19bc5c173c6d89b11"} Jul 10 14:45:35.997849 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.997810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" event={"ID":"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8","Type":"ContainerStarted","Data":"f15f7bd7d16eee431b1cf1454e2423cdd689a17b11b4b2ff65ab1fc8a3afbb95"} Jul 10 14:45:35.998784 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.998765 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" event={"ID":"29b0f027-562f-459a-aec1-d732891582e8","Type":"ContainerStarted","Data":"65d2f94c75fc6e0aa8a07723bc80dedc8a95a30e334106726bd54c76834745bd"} Jul 10 14:45:35.999694 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:35.999674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" event={"ID":"7b37164e-7bef-4517-a76b-8bdd9c8b4e71","Type":"ContainerStarted","Data":"b7eb4988d53241a578d31b8806aafdbb8216af97b847fe2c2a3d7462b9ad0dcc"} Jul 10 14:45:36.000596 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.000577 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dvjhp" event={"ID":"6459c64f-420e-4b7f-ba05-c6b347b135e5","Type":"ContainerStarted","Data":"4b0e2340dd440451e31d7e7d14e65e454b62312a668f8010232ae01c38ad138a"} Jul 10 14:45:36.636695 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.635906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:36.636695 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.636282 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:36.636695 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.636352 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls podName:d3d58457-f9df-4a93-b5a0-a20802e2b9cf nodeName:}" failed. No retries permitted until 2026-07-10 14:45:38.636331377 +0000 UTC m=+41.502761656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bw5sh" (UID: "d3d58457-f9df-4a93-b5a0-a20802e2b9cf") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.737265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.737350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.737432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.737480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.737633 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:38.737615547 +0000 UTC m=+41.604045843 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : configmap references non-existent config key: service-ca.crt Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.738053 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.738104 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:38.738087453 +0000 UTC m=+41.604517733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : secret "router-metrics-certs-default" not found Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.738167 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.738196 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls podName:30e3b9c0-db77-49c9-a18f-6acf08199234 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:38.738186285 +0000 UTC m=+41.604616561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls") pod "cluster-samples-operator-65db858894-p2kfz" (UID: "30e3b9c0-db77-49c9-a18f-6acf08199234") : secret "samples-operator-tls" not found Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.738259 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.738269 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8664978b5b-jvc8t: secret "image-registry-tls" not found Jul 10 14:45:36.738352 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.738298 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls podName:fee07384-d124-4723-a25c-db8c46b1064f nodeName:}" failed. No retries permitted until 2026-07-10 14:45:38.7382884 +0000 UTC m=+41.604718675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls") pod "image-registry-8664978b5b-jvc8t" (UID: "fee07384-d124-4723-a25c-db8c46b1064f") : secret "image-registry-tls" not found Jul 10 14:45:36.801720 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.801692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:45:36.803384 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.802145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:45:36.803384 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.802514 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:45:36.806835 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.805759 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-55wnk\"" Jul 10 14:45:36.806835 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.806017 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfp6g\"" Jul 10 14:45:36.806835 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.806199 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:45:36.806835 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.806401 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:45:36.838805 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:36.838354 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:36.838805 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.838468 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:45:36.838805 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:36.838541 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls podName:16d26c4e-bf87-4cb7-bf2f-b317d5500cc4 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:38.838523645 +0000 UTC m=+41.704953934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls") pod "dns-default-5v76q" (UID: "16d26c4e-bf87-4cb7-bf2f-b317d5500cc4") : secret "dns-default-metrics-tls" not found Jul 10 14:45:38.013182 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.013144 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" event={"ID":"7b37164e-7bef-4517-a76b-8bdd9c8b4e71","Type":"ContainerStarted","Data":"bd93caf10ca11d05fb151dec43178cfc250524c1c47253066b777c76598eb639"} Jul 10 14:45:38.037141 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.037097 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-tn9g8" podStartSLOduration=13.005289866 podStartE2EDuration="15.037083204s" totalImagesPullingTime="2.031793338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:38.035876462 +0000 UTC m=+40.902306782" watchObservedRunningTime="2026-07-10 14:45:38.037083204 +0000 UTC m=+40.903513499" Jul 10 14:45:38.126488 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.126448 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:38.192924 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.192862 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:38.658497 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.658466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:38.658651 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.658614 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:38.658701 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.658681 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls podName:d3d58457-f9df-4a93-b5a0-a20802e2b9cf nodeName:}" failed. No retries permitted until 2026-07-10 14:45:42.658664376 +0000 UTC m=+45.525094648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bw5sh" (UID: "d3d58457-f9df-4a93-b5a0-a20802e2b9cf") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:38.719433 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.719395 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:38.759242 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.759216 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:38.759364 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.759270 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:38.759364 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759327 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:42.759304227 +0000 UTC m=+45.625734499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : configmap references non-existent config key: service-ca.crt Jul 10 14:45:38.759485 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.759362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:38.759485 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759379 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:45:38.759485 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759432 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:42.759413222 +0000 UTC m=+45.625843496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : secret "router-metrics-certs-default" not found Jul 10 14:45:38.759485 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759470 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:45:38.759485 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.759478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:38.759706 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759512 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls podName:30e3b9c0-db77-49c9-a18f-6acf08199234 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:42.759499462 +0000 UTC m=+45.625929735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls") pod "cluster-samples-operator-65db858894-p2kfz" (UID: "30e3b9c0-db77-49c9-a18f-6acf08199234") : secret "samples-operator-tls" not found Jul 10 14:45:38.759706 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759569 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:45:38.759706 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759580 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8664978b5b-jvc8t: secret "image-registry-tls" not found Jul 10 14:45:38.759706 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.759615 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls podName:fee07384-d124-4723-a25c-db8c46b1064f nodeName:}" failed. No retries permitted until 2026-07-10 14:45:42.759605569 +0000 UTC m=+45.626035844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls") pod "image-registry-8664978b5b-jvc8t" (UID: "fee07384-d124-4723-a25c-db8c46b1064f") : secret "image-registry-tls" not found Jul 10 14:45:38.821307 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.821268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:38.860718 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.860683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:38.860869 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.860846 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:45:38.860943 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:38.860918 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls podName:16d26c4e-bf87-4cb7-bf2f-b317d5500cc4 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:42.860900458 +0000 UTC m=+45.727330735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls") pod "dns-default-5v76q" (UID: "16d26c4e-bf87-4cb7-bf2f-b317d5500cc4") : secret "dns-default-metrics-tls" not found Jul 10 14:45:38.924396 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:38.924330 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:39.725684 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:39.725651 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:39.821492 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:39.821462 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:42.693336 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:42.693303 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:42.693690 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.693459 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:42.693690 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.693518 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls podName:d3d58457-f9df-4a93-b5a0-a20802e2b9cf nodeName:}" failed. No retries permitted until 2026-07-10 14:45:50.693503238 +0000 UTC m=+53.559933510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bw5sh" (UID: "d3d58457-f9df-4a93-b5a0-a20802e2b9cf") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:42.794793 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:42.794618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:42.794911 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.794755 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:45:42.794911 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:42.794859 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:42.794911 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.794885 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:50.794870645 +0000 UTC m=+53.661300917 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : secret "router-metrics-certs-default" not found Jul 10 14:45:42.795086 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.794946 2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 14:45:42.795086 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:42.794969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:42.795086 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.794983 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls podName:30e3b9c0-db77-49c9-a18f-6acf08199234 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:50.794971722 +0000 UTC m=+53.661401999 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls") pod "cluster-samples-operator-65db858894-p2kfz" (UID: "30e3b9c0-db77-49c9-a18f-6acf08199234") : secret "samples-operator-tls" not found Jul 10 14:45:42.795086 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:42.795024 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:42.795086 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.795026 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:45:42.795086 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.795076 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8664978b5b-jvc8t: secret "image-registry-tls" not found Jul 10 14:45:42.795381 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.795076 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:45:50.795067912 +0000 UTC m=+53.661498183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : configmap references non-existent config key: service-ca.crt Jul 10 14:45:42.795381 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.795113 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls podName:fee07384-d124-4723-a25c-db8c46b1064f nodeName:}" failed. No retries permitted until 2026-07-10 14:45:50.795101916 +0000 UTC m=+53.661532191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls") pod "image-registry-8664978b5b-jvc8t" (UID: "fee07384-d124-4723-a25c-db8c46b1064f") : secret "image-registry-tls" not found Jul 10 14:45:42.896446 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:42.896415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:42.896604 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.896587 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:45:42.896655 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:42.896650 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls podName:16d26c4e-bf87-4cb7-bf2f-b317d5500cc4 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:50.896631189 +0000 UTC m=+53.763061463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls") pod "dns-default-5v76q" (UID: "16d26c4e-bf87-4cb7-bf2f-b317d5500cc4") : secret "dns-default-metrics-tls" not found Jul 10 14:45:43.029965 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.029934 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" event={"ID":"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8","Type":"ContainerStarted","Data":"97927a69a9771dd4216a2ec07b6d77ed781283915780cc659a2ae055679bc3ca"} Jul 10 14:45:43.031030 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.031003 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" event={"ID":"29b0f027-562f-459a-aec1-d732891582e8","Type":"ContainerStarted","Data":"9da33923e23aba35aa7b511e99597dbeffb15de33a32723a2e1e2f9c4bc99dda"} Jul 10 14:45:43.032516 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.032492 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dvjhp" event={"ID":"6459c64f-420e-4b7f-ba05-c6b347b135e5","Type":"ContainerStarted","Data":"7d51bf76e520a25cbfef4221a76b7ea7a0b3a418423c9ad4cd001b081f15dbcf"} Jul 10 14:45:43.035153 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.035127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" event={"ID":"0f7278e3-9957-4dc1-8155-7fd34da42fba","Type":"ContainerStarted","Data":"021e98fc0d00c77a8a72da0ed37dc2a260eefff2557e480a47ce4a60fb82bc8a"} Jul 10 14:45:43.036759 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.036736 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/0.log" Jul 10 14:45:43.036838 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.036776 2572 generic.go:356] "Generic (PLEG): container finished" podID="39a791a9-9f83-40a1-af78-f63ebea452b6" containerID="908be21c5fd785474c26a24e54a501e85df54a376223f0ba9a5e8f92162556de" exitCode=255 Jul 10 14:45:43.037095 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.037080 2572 scope.go:117] "RemoveContainer" containerID="908be21c5fd785474c26a24e54a501e85df54a376223f0ba9a5e8f92162556de" Jul 10 14:45:43.037293 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.037272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxf5k" event={"ID":"39a791a9-9f83-40a1-af78-f63ebea452b6","Type":"ContainerDied","Data":"908be21c5fd785474c26a24e54a501e85df54a376223f0ba9a5e8f92162556de"} Jul 10 14:45:43.040759 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.039060 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" event={"ID":"dd5ada5a-d874-4cd9-89a7-ca7c73126866","Type":"ContainerStarted","Data":"c221edab6a1c0ef530560ab6ceffe042f82cf9aaa69541f838ffb66b2696ea57"} Jul 10 14:45:43.059943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.059884 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" podStartSLOduration=19.896892129 podStartE2EDuration="27.059866045s" totalImagesPullingTime="7.162973916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:43.058464933 +0000 UTC m=+45.924895250" watchObservedRunningTime="2026-07-10 14:45:43.059866045 +0000 UTC m=+45.926296339" Jul 10 14:45:43.176804 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.176749 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" podStartSLOduration=9.981181072 podStartE2EDuration="17.176726045s" totalImagesPullingTime="7.195544973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:43.133788513 +0000 UTC m=+46.000218808" watchObservedRunningTime="2026-07-10 14:45:43.176726045 +0000 UTC m=+46.043156340" Jul 10 14:45:43.177707 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.177666 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" podStartSLOduration=9.994067686 podStartE2EDuration="17.17765281s" totalImagesPullingTime="7.183585124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:43.177240538 +0000 UTC m=+46.043670833" watchObservedRunningTime="2026-07-10 14:45:43.17765281 +0000 UTC m=+46.044083107" Jul 10 14:45:43.209469 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.209227 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-n48nt" podStartSLOduration=7.074428601 podStartE2EDuration="14.209208594s" totalImagesPullingTime="7.134779993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:43.207028472 +0000 UTC m=+46.073458767" watchObservedRunningTime="2026-07-10 14:45:43.209208594 +0000 UTC m=+46.075638889" Jul 10 14:45:43.240567 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.240169 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dvjhp" podStartSLOduration=2.111479836 podStartE2EDuration="9.24015046s" totalImagesPullingTime="7.128670624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:43.239154088 +0000 UTC m=+46.105584382" watchObservedRunningTime="2026-07-10 14:45:43.24015046 +0000 UTC m=+46.106580755" Jul 10 14:45:43.568951 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.568865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:43.678216 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.678179 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:43.775059 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.775028 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:43.989231 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:43.989196 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:44.018096 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.018059 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl"] Jul 10 14:45:44.026921 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.026890 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" Jul 10 14:45:44.030166 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.030120 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kdjkx\"" Jul 10 14:45:44.030166 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.030143 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 14:45:44.030930 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.030914 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 14:45:44.047993 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.046999 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/1.log" Jul 10 14:45:44.047993 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.047566 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/0.log" Jul 10 14:45:44.047993 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.047609 2572 generic.go:356] "Generic (PLEG): container finished" podID="39a791a9-9f83-40a1-af78-f63ebea452b6" containerID="9a716792dfec6eaa4e40e700edfb2eb73b9ba47b3cd83ef92bd8e8f375193a77" exitCode=255 Jul 10 14:45:44.047993 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.047888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxf5k" event={"ID":"39a791a9-9f83-40a1-af78-f63ebea452b6","Type":"ContainerDied","Data":"9a716792dfec6eaa4e40e700edfb2eb73b9ba47b3cd83ef92bd8e8f375193a77"} Jul 10 14:45:44.048280 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.048175 2572 scope.go:117] "RemoveContainer" containerID="908be21c5fd785474c26a24e54a501e85df54a376223f0ba9a5e8f92162556de" Jul 10 14:45:44.049716 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.048636 2572 scope.go:117] "RemoveContainer" containerID="9a716792dfec6eaa4e40e700edfb2eb73b9ba47b3cd83ef92bd8e8f375193a77" Jul 10 14:45:44.049716 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:44.048895 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mxf5k_openshift-console-operator(39a791a9-9f83-40a1-af78-f63ebea452b6)\"" pod="openshift-console-operator/console-operator-7866497494-mxf5k" podUID="39a791a9-9f83-40a1-af78-f63ebea452b6" Jul 10 14:45:44.052851 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.052809 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl"] Jul 10 14:45:44.107063 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.107021 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpg78\" (UniqueName: \"kubernetes.io/projected/eab93726-2af6-4515-9afb-0d3660e8ff38-kube-api-access-zpg78\") pod \"migrator-7f59b54f6c-24vgl\" (UID: \"eab93726-2af6-4515-9afb-0d3660e8ff38\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" Jul 10 14:45:44.108122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.108094 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:44.201783 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.201734 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:44.209019 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.208998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpg78\" (UniqueName: \"kubernetes.io/projected/eab93726-2af6-4515-9afb-0d3660e8ff38-kube-api-access-zpg78\") pod \"migrator-7f59b54f6c-24vgl\" (UID: \"eab93726-2af6-4515-9afb-0d3660e8ff38\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" Jul 10 14:45:44.218692 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.218668 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpg78\" (UniqueName: \"kubernetes.io/projected/eab93726-2af6-4515-9afb-0d3660e8ff38-kube-api-access-zpg78\") pod \"migrator-7f59b54f6c-24vgl\" (UID: \"eab93726-2af6-4515-9afb-0d3660e8ff38\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" Jul 10 14:45:44.337494 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.337437 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" Jul 10 14:45:44.495410 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.495263 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl"] Jul 10 14:45:44.498683 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:45:44.498653 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab93726_2af6_4515_9afb_0d3660e8ff38.slice/crio-9aff06a7e7c867558b915afae962bf92847c3967063756e4015fb3a85b72417c WatchSource:0}: Error finding container 9aff06a7e7c867558b915afae962bf92847c3967063756e4015fb3a85b72417c: Status 404 returned error can't find the container with id 9aff06a7e7c867558b915afae962bf92847c3967063756e4015fb3a85b72417c Jul 10 14:45:44.546282 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.546257 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:44.626763 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.626696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:44.829522 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.829492 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bgh22"] Jul 10 14:45:44.832527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.832501 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:44.860176 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.860155 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:44.865046 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.865027 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 14:45:44.865157 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.865045 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 14:45:44.865227 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.865153 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dx9zp\"" Jul 10 14:45:44.896262 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.896236 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgh22"] Jul 10 14:45:44.914020 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.913998 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12c75e4-7905-4cb1-88df-1bb840f82a81-data-volume\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:44.914121 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.914027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:44.914121 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.914045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:44.914209 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.914125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqf6f\" (UniqueName: \"kubernetes.io/projected/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-api-access-nqf6f\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:44.914282 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:44.914260 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e12c75e4-7905-4cb1-88df-1bb840f82a81-crio-socket\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.010339 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.010306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:45.015166 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.015142 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqf6f\" (UniqueName: \"kubernetes.io/projected/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-api-access-nqf6f\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.015279 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.015220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e12c75e4-7905-4cb1-88df-1bb840f82a81-crio-socket\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.015279 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.015273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12c75e4-7905-4cb1-88df-1bb840f82a81-data-volume\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.015399 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.015378 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.015452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.015415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.015452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.015439 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e12c75e4-7905-4cb1-88df-1bb840f82a81-crio-socket\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.015532 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.015495 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:45:45.015563 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.015544 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:45:45.015563 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.015553 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e12c75e4-7905-4cb1-88df-1bb840f82a81-data-volume\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.015617 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.015558 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:45.515542173 +0000 UTC m=+48.381972453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : configmap "kube-rbac-proxy" not found Jul 10 14:45:45.015617 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.015602 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:45.515589001 +0000 UTC m=+48.382019273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : secret "insights-runtime-extractor-tls" not found Jul 10 14:45:45.025112 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.025090 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqf6f\" (UniqueName: \"kubernetes.io/projected/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-api-access-nqf6f\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.052196 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.052172 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" event={"ID":"eab93726-2af6-4515-9afb-0d3660e8ff38","Type":"ContainerStarted","Data":"9aff06a7e7c867558b915afae962bf92847c3967063756e4015fb3a85b72417c"} Jul 10 14:45:45.053462 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.053446 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/1.log" Jul 10 14:45:45.053782 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.053766 2572 scope.go:117] "RemoveContainer" containerID="9a716792dfec6eaa4e40e700edfb2eb73b9ba47b3cd83ef92bd8e8f375193a77" Jul 10 14:45:45.053953 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.053933 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mxf5k_openshift-console-operator(39a791a9-9f83-40a1-af78-f63ebea452b6)\"" pod="openshift-console-operator/console-operator-7866497494-mxf5k" podUID="39a791a9-9f83-40a1-af78-f63ebea452b6" Jul 10 14:45:45.356548 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.356514 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:45.356708 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.356585 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:45:45.515483 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.515406 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:45.518342 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.518315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.518423 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:45.518358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:45.518423 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.518417 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:45:45.518515 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.518470 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:46.518454544 +0000 UTC m=+49.384884829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : configmap "kube-rbac-proxy" not found Jul 10 14:45:45.518558 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.518515 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:45:45.518587 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:45.518571 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:46.518556597 +0000 UTC m=+49.384986883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : secret "insights-runtime-extractor-tls" not found Jul 10 14:45:46.057095 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.057071 2572 scope.go:117] "RemoveContainer" containerID="9a716792dfec6eaa4e40e700edfb2eb73b9ba47b3cd83ef92bd8e8f375193a77" Jul 10 14:45:46.057456 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:46.057220 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mxf5k_openshift-console-operator(39a791a9-9f83-40a1-af78-f63ebea452b6)\"" pod="openshift-console-operator/console-operator-7866497494-mxf5k" podUID="39a791a9-9f83-40a1-af78-f63ebea452b6" Jul 10 14:45:46.390952 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.390931 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-t2mx8"] Jul 10 14:45:46.401728 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.401709 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.406543 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.404440 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nzsvz\"" Jul 10 14:45:46.406543 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.404688 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 10 14:45:46.406543 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.404787 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 10 14:45:46.406543 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.405121 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-t2mx8"] Jul 10 14:45:46.406782 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.406587 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 10 14:45:46.407192 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.406986 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 10 14:45:46.426645 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.426624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zk57\" (UniqueName: \"kubernetes.io/projected/230f34d2-234b-44cb-b88f-c4a546edab4a-kube-api-access-5zk57\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.426725 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.426674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/230f34d2-234b-44cb-b88f-c4a546edab4a-signing-cabundle\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.426770 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.426727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/230f34d2-234b-44cb-b88f-c4a546edab4a-signing-key\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.428779 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.428703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:46.518286 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.518259 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:46.527393 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.527370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/230f34d2-234b-44cb-b88f-c4a546edab4a-signing-cabundle\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.527480 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.527407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/230f34d2-234b-44cb-b88f-c4a546edab4a-signing-key\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.527480 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.527450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:46.527480 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.527465 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:46.527638 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:46.527561 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:45:46.527638 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:46.527578 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:45:46.527638 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.527584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zk57\" (UniqueName: \"kubernetes.io/projected/230f34d2-234b-44cb-b88f-c4a546edab4a-kube-api-access-5zk57\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.527638 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:46.527621 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:48.527601806 +0000 UTC m=+51.394032102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : configmap "kube-rbac-proxy" not found Jul 10 14:45:46.527841 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:46.527707 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:48.527683147 +0000 UTC m=+51.394113427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : secret "insights-runtime-extractor-tls" not found Jul 10 14:45:46.528120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.528097 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/230f34d2-234b-44cb-b88f-c4a546edab4a-signing-cabundle\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.530608 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.530589 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/230f34d2-234b-44cb-b88f-c4a546edab4a-signing-key\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.536470 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.536450 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zk57\" (UniqueName: \"kubernetes.io/projected/230f34d2-234b-44cb-b88f-c4a546edab4a-kube-api-access-5zk57\") pod \"service-ca-79f68b9f4f-t2mx8\" (UID: \"230f34d2-234b-44cb-b88f-c4a546edab4a\") " pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.618407 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.618356 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:46.714130 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.714109 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" Jul 10 14:45:46.857606 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:46.857575 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-t2mx8"] Jul 10 14:45:46.860227 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:45:46.860203 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod230f34d2_234b_44cb_b88f_c4a546edab4a.slice/crio-bedb4b57d32ed51bec645fb50f8b7afa384de5ae369ecc3085acbf08fa6d4e3f WatchSource:0}: Error finding container bedb4b57d32ed51bec645fb50f8b7afa384de5ae369ecc3085acbf08fa6d4e3f: Status 404 returned error can't find the container with id bedb4b57d32ed51bec645fb50f8b7afa384de5ae369ecc3085acbf08fa6d4e3f Jul 10 14:45:47.061650 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.061619 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" event={"ID":"230f34d2-234b-44cb-b88f-c4a546edab4a","Type":"ContainerStarted","Data":"d53163f1f934fbebb14cd8335eb50711d28ec6067cb197a632cb718491dea083"} Jul 10 14:45:47.062078 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.061680 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" event={"ID":"230f34d2-234b-44cb-b88f-c4a546edab4a","Type":"ContainerStarted","Data":"bedb4b57d32ed51bec645fb50f8b7afa384de5ae369ecc3085acbf08fa6d4e3f"} Jul 10 14:45:47.063442 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.063421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" event={"ID":"eab93726-2af6-4515-9afb-0d3660e8ff38","Type":"ContainerStarted","Data":"95cfe523e4beff39a44ad01a95cb2757e0dcc336fe9df281dcbd0cd49ff758fa"} Jul 10 14:45:47.063530 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.063460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" event={"ID":"eab93726-2af6-4515-9afb-0d3660e8ff38","Type":"ContainerStarted","Data":"a31d10726eee18be81cdd4ce5c6bcaf736e9625858d1fb0daeb74fdb5a49f435"} Jul 10 14:45:47.084959 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.084939 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkv9v_b9adadb8-1cc0-48ab-ad0f-52a587f7abf3/dns-node-resolver/0.log" Jul 10 14:45:47.093320 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.093276 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-t2mx8" podStartSLOduration=1.093261759 podStartE2EDuration="1.093261759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:47.092557392 +0000 UTC m=+49.958987685" watchObservedRunningTime="2026-07-10 14:45:47.093261759 +0000 UTC m=+49.959692052" Jul 10 14:45:47.124457 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.124423 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-24vgl" podStartSLOduration=2.333675316 podStartE2EDuration="4.124411042s" totalImagesPullingTime="1.790735726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:47.123884529 +0000 UTC m=+49.990314829" watchObservedRunningTime="2026-07-10 14:45:47.124411042 +0000 UTC m=+49.990841335" Jul 10 14:45:47.739211 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.739177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:47.883322 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:47.883302 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sbzq6_668c6dc2-cade-4e9a-994f-cc374fdad086/node-ca/0.log" Jul 10 14:45:48.136063 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.135978 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:48.234572 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.234532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:48.335565 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.335533 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:48.441763 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.441734 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:48.497127 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.497107 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dvjhp_6459c64f-420e-4b7f-ba05-c6b347b135e5/serve-healthcheck-canary/0.log" Jul 10 14:45:48.543155 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.543130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:48.543244 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.543168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:48.543293 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:48.543258 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:45:48.543340 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:48.543322 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:52.543302906 +0000 UTC m=+55.409733182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : configmap "kube-rbac-proxy" not found Jul 10 14:45:48.543410 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:48.543374 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:45:48.543458 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:48.543428 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:45:52.543411699 +0000 UTC m=+55.409841972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : secret "insights-runtime-extractor-tls" not found Jul 10 14:45:48.610283 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.610259 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:48.685548 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.685522 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-24vgl_eab93726-2af6-4515-9afb-0d3660e8ff38/migrator/0.log" Jul 10 14:45:48.887997 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:48.887973 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-24vgl_eab93726-2af6-4515-9afb-0d3660e8ff38/graceful-termination/0.log" Jul 10 14:45:49.019757 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:49.019721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:49.086763 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:49.086737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-dlls9_dd5ada5a-d874-4cd9-89a7-ca7c73126866/kube-storage-version-migrator-operator/0.log" Jul 10 14:45:49.609126 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:49.609102 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.099310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.099281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.201071 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.201041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.299961 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.299937 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.400233 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.400201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.626669 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.626645 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.699397 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.699337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.762614 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.762585 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:45:50.762785 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.762765 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:50.762863 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.762854 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls podName:d3d58457-f9df-4a93-b5a0-a20802e2b9cf nodeName:}" failed. No retries permitted until 2026-07-10 14:46:06.762833266 +0000 UTC m=+69.629263553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-bw5sh" (UID: "d3d58457-f9df-4a93-b5a0-a20802e2b9cf") : secret "cluster-monitoring-operator-tls" not found Jul 10 14:45:50.795336 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.795298 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:50.863491 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.863467 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:45:50.863578 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.863507 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:50.863625 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.863608 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:46:06.863596976 +0000 UTC m=+69.730027247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : configmap references non-existent config key: service-ca.crt Jul 10 14:45:50.863668 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.863620 2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 14:45:50.863668 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.863639 2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8664978b5b-jvc8t: secret "image-registry-tls" not found Jul 10 14:45:50.863747 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.863684 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls podName:fee07384-d124-4723-a25c-db8c46b1064f nodeName:}" failed. No retries permitted until 2026-07-10 14:46:06.863669052 +0000 UTC m=+69.730099329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls") pod "image-registry-8664978b5b-jvc8t" (UID: "fee07384-d124-4723-a25c-db8c46b1064f") : secret "image-registry-tls" not found Jul 10 14:45:50.863747 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.863724 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:45:50.863842 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.863780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:50.863895 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.863882 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 14:45:50.863949 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.863936 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs podName:4ce3dca2-270f-47dc-b47a-1ac7c17f041b nodeName:}" failed. No retries permitted until 2026-07-10 14:46:06.863923508 +0000 UTC m=+69.730353798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs") pod "router-default-57f4976748-f5s4v" (UID: "4ce3dca2-270f-47dc-b47a-1ac7c17f041b") : secret "router-metrics-certs-default" not found Jul 10 14:45:50.866099 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.866076 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30e3b9c0-db77-49c9-a18f-6acf08199234-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-p2kfz\" (UID: \"30e3b9c0-db77-49c9-a18f-6acf08199234\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:50.891369 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.891351 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" Jul 10 14:45:50.965323 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:50.965258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:45:50.965458 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.965414 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 14:45:50.965518 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:50.965502 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls podName:16d26c4e-bf87-4cb7-bf2f-b317d5500cc4 nodeName:}" failed. No retries permitted until 2026-07-10 14:46:06.965479664 +0000 UTC m=+69.831909957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls") pod "dns-default-5v76q" (UID: "16d26c4e-bf87-4cb7-bf2f-b317d5500cc4") : secret "dns-default-metrics-tls" not found Jul 10 14:45:51.017689 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:51.017656 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz"] Jul 10 14:45:51.024288 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:51.024262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:51.079607 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:51.079587 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" event={"ID":"30e3b9c0-db77-49c9-a18f-6acf08199234","Type":"ContainerStarted","Data":"def7d790b890542da2d187c92a78ff5197d7b297634fe9d9099a51623e4b4d3d"} Jul 10 14:45:51.406048 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:51.405982 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:51.625337 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:51.625308 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:51.795218 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:51.795125 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:52.135868 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.135766 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:52.237177 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.237145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:52.397728 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.397694 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:52.498788 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.498754 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:52.579767 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.579739 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:52.579919 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.579776 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:45:52.579919 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:52.579879 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 14:45:52.580029 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:52.579954 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:46:00.579932667 +0000 UTC m=+63.446362952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : configmap "kube-rbac-proxy" not found Jul 10 14:45:52.580029 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:52.579959 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 14:45:52.580029 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:52.580017 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls podName:e12c75e4-7905-4cb1-88df-1bb840f82a81 nodeName:}" failed. No retries permitted until 2026-07-10 14:46:00.579997754 +0000 UTC m=+63.446428030 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bgh22" (UID: "e12c75e4-7905-4cb1-88df-1bb840f82a81") : secret "insights-runtime-extractor-tls" not found Jul 10 14:45:52.599097 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.599070 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:52.700348 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.700281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:52.801406 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:52.801371 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:53.996606 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:53.996573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:54.091580 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.091541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" event={"ID":"30e3b9c0-db77-49c9-a18f-6acf08199234","Type":"ContainerStarted","Data":"ca9ccbe1aa860765ff92307e24db1af65757806c089e3dc9a08ea528fd693baa"} Jul 10 14:45:54.091730 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.091597 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" event={"ID":"30e3b9c0-db77-49c9-a18f-6acf08199234","Type":"ContainerStarted","Data":"bf9b9fc29cf319f5fc6b1d4a0bf4b863393e64f94c35711c21853e103d7862ad"} Jul 10 14:45:54.108426 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.108381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-p2kfz" podStartSLOduration=30.008656453 podStartE2EDuration="32.108367881s" totalImagesPullingTime="2.099711428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:54.106718852 +0000 UTC m=+56.973149145" watchObservedRunningTime="2026-07-10 14:45:54.108367881 +0000 UTC m=+56.974798183" Jul 10 14:45:54.188890 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.188851 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:54.392480 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.392450 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:54.597310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.597280 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:54.725214 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.725137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:54.914076 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:54.914044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:55.474413 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:55.474380 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:55.579272 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:55.579245 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:55.808255 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:55.808198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:55.993241 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:55.993206 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:56.390255 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:56.390236 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:56.589793 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:56.589770 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:57.201723 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:57.201693 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:57.273602 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:57.273569 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:57.614734 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:57.614667 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:57.803397 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:57.803367 2572 scope.go:117] "RemoveContainer" containerID="9a716792dfec6eaa4e40e700edfb2eb73b9ba47b3cd83ef92bd8e8f375193a77" Jul 10 14:45:57.813198 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:57.813167 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:58.108119 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.108089 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:45:58.108510 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.108497 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/1.log" Jul 10 14:45:58.108565 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.108526 2572 generic.go:356] "Generic (PLEG): container finished" podID="39a791a9-9f83-40a1-af78-f63ebea452b6" containerID="f10e184c8531610453fca23cbfd987eada28e96b3b84b7de603937fca5b8ef37" exitCode=255 Jul 10 14:45:58.108565 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.108550 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxf5k" event={"ID":"39a791a9-9f83-40a1-af78-f63ebea452b6","Type":"ContainerDied","Data":"f10e184c8531610453fca23cbfd987eada28e96b3b84b7de603937fca5b8ef37"} Jul 10 14:45:58.108655 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.108589 2572 scope.go:117] "RemoveContainer" containerID="9a716792dfec6eaa4e40e700edfb2eb73b9ba47b3cd83ef92bd8e8f375193a77" Jul 10 14:45:58.108927 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.108902 2572 scope.go:117] "RemoveContainer" containerID="f10e184c8531610453fca23cbfd987eada28e96b3b84b7de603937fca5b8ef37" Jul 10 14:45:58.109098 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:45:58.109075 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-mxf5k_openshift-console-operator(39a791a9-9f83-40a1-af78-f63ebea452b6)\"" pod="openshift-console-operator/console-operator-7866497494-mxf5k" podUID="39a791a9-9f83-40a1-af78-f63ebea452b6" Jul 10 14:45:58.196518 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.196453 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:58.594376 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:58.594312 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:59.112360 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:59.112338 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:45:59.486182 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:59.486152 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:59.584949 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:59.584921 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:45:59.979559 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:45:59.979540 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-l8bbk" Jul 10 14:46:00.644754 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:00.644721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:46:00.644754 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:00.644755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:46:00.645229 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:00.645211 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e12c75e4-7905-4cb1-88df-1bb840f82a81-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:46:00.646875 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:00.646860 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e12c75e4-7905-4cb1-88df-1bb840f82a81-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bgh22\" (UID: \"e12c75e4-7905-4cb1-88df-1bb840f82a81\") " pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:46:00.773797 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:00.773777 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dx9zp\"" Jul 10 14:46:00.782069 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:00.782055 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bgh22" Jul 10 14:46:00.900175 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:00.900152 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bgh22"] Jul 10 14:46:00.902609 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:00.902586 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12c75e4_7905_4cb1_88df_1bb840f82a81.slice/crio-55b95e73bb0f6f89a5252673298c29e459bd09fe64115dd27fdca48b8a2aa304 WatchSource:0}: Error finding container 55b95e73bb0f6f89a5252673298c29e459bd09fe64115dd27fdca48b8a2aa304: Status 404 returned error can't find the container with id 55b95e73bb0f6f89a5252673298c29e459bd09fe64115dd27fdca48b8a2aa304 Jul 10 14:46:01.119278 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:01.119243 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgh22" event={"ID":"e12c75e4-7905-4cb1-88df-1bb840f82a81","Type":"ContainerStarted","Data":"55b95e73bb0f6f89a5252673298c29e459bd09fe64115dd27fdca48b8a2aa304"} Jul 10 14:46:03.368004 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.367637 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:46:03.368004 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.367809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:46:03.370495 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.370473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:46:03.371416 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.371383 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:46:03.380636 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.380605 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cf80ce30-07ad-4e45-988b-735088a856b2-original-pull-secret\") pod \"global-pull-secret-syncer-hp7mt\" (UID: \"cf80ce30-07ad-4e45-988b-735088a856b2\") " pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:46:03.380859 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.380836 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c25f2ef-9cec-48f5-9257-84db67d53ff7-metrics-certs\") pod \"network-metrics-daemon-cs6cg\" (UID: \"7c25f2ef-9cec-48f5-9257-84db67d53ff7\") " pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:46:03.468598 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.468558 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:46:03.471195 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.471172 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cwsx\" (UniqueName: \"kubernetes.io/projected/37bca1ba-3919-4eb0-a9a7-d2bc40dac515-kube-api-access-7cwsx\") pod \"network-check-target-2pjg8\" (UID: \"37bca1ba-3919-4eb0-a9a7-d2bc40dac515\") " pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:46:03.520329 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.520285 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hp7mt" Jul 10 14:46:03.531737 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.531714 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gfp6g\"" Jul 10 14:46:03.539896 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.539876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:46:03.540019 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.540001 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-55wnk\"" Jul 10 14:46:03.548851 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:03.548830 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cs6cg" Jul 10 14:46:05.113204 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.113142 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:05.136871 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.136838 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgh22" event={"ID":"e12c75e4-7905-4cb1-88df-1bb840f82a81","Type":"ContainerStarted","Data":"2897909b52ce894cbb292c8d6a3625ddd98543f2e6d5fe7cfd97366608f0e61f"} Jul 10 14:46:05.146168 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.146144 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hp7mt"] Jul 10 14:46:05.148906 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:05.148881 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf80ce30_07ad_4e45_988b_735088a856b2.slice/crio-96a8b92ca3ff2c88604150f3ff2f41177209345312146dd6154aec9eb1c96328 WatchSource:0}: Error finding container 96a8b92ca3ff2c88604150f3ff2f41177209345312146dd6154aec9eb1c96328: Status 404 returned error can't find the container with id 96a8b92ca3ff2c88604150f3ff2f41177209345312146dd6154aec9eb1c96328 Jul 10 14:46:05.214135 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.214109 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:05.356603 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.356546 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:46:05.356603 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.356589 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:46:05.356885 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.356871 2572 scope.go:117] "RemoveContainer" containerID="f10e184c8531610453fca23cbfd987eada28e96b3b84b7de603937fca5b8ef37" Jul 10 14:46:05.357027 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:46:05.357009 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-mxf5k_openshift-console-operator(39a791a9-9f83-40a1-af78-f63ebea452b6)\"" pod="openshift-console-operator/console-operator-7866497494-mxf5k" podUID="39a791a9-9f83-40a1-af78-f63ebea452b6" Jul 10 14:46:05.362788 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.362769 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cs6cg"] Jul 10 14:46:05.365553 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:05.365407 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c25f2ef_9cec_48f5_9257_84db67d53ff7.slice/crio-41e78707caa083eeefcf225238ada1a7d99a60d5858b873a200a87806168b050 WatchSource:0}: Error finding container 41e78707caa083eeefcf225238ada1a7d99a60d5858b873a200a87806168b050: Status 404 returned error can't find the container with id 41e78707caa083eeefcf225238ada1a7d99a60d5858b873a200a87806168b050 Jul 10 14:46:05.366943 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:05.366922 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2pjg8"] Jul 10 14:46:05.369072 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:05.369041 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37bca1ba_3919_4eb0_a9a7_d2bc40dac515.slice/crio-2b53f2841a759a398c505141fdddc6428fa6d8126b9831136a43f1a8543e2b0b WatchSource:0}: Error finding container 2b53f2841a759a398c505141fdddc6428fa6d8126b9831136a43f1a8543e2b0b: Status 404 returned error can't find the container with id 2b53f2841a759a398c505141fdddc6428fa6d8126b9831136a43f1a8543e2b0b Jul 10 14:46:06.143125 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.143089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2pjg8" event={"ID":"37bca1ba-3919-4eb0-a9a7-d2bc40dac515","Type":"ContainerStarted","Data":"fbb0392fdffcbb875d0c3245bba095d498ac44be51c8bac8f28556d2abb34bb0"} Jul 10 14:46:06.143655 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.143147 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2pjg8" event={"ID":"37bca1ba-3919-4eb0-a9a7-d2bc40dac515","Type":"ContainerStarted","Data":"2b53f2841a759a398c505141fdddc6428fa6d8126b9831136a43f1a8543e2b0b"} Jul 10 14:46:06.143655 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.143199 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:46:06.150146 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.150114 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hp7mt" event={"ID":"cf80ce30-07ad-4e45-988b-735088a856b2","Type":"ContainerStarted","Data":"96a8b92ca3ff2c88604150f3ff2f41177209345312146dd6154aec9eb1c96328"} Jul 10 14:46:06.151452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.151398 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cs6cg" event={"ID":"7c25f2ef-9cec-48f5-9257-84db67d53ff7","Type":"ContainerStarted","Data":"41e78707caa083eeefcf225238ada1a7d99a60d5858b873a200a87806168b050"} Jul 10 14:46:06.163338 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.163285 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2pjg8" podStartSLOduration=68.16326106 podStartE2EDuration="1m8.16326106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:06.162480507 +0000 UTC m=+69.028910821" watchObservedRunningTime="2026-07-10 14:46:06.16326106 +0000 UTC m=+69.029691353" Jul 10 14:46:06.797179 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.797111 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:46:06.799613 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.799586 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d3d58457-f9df-4a93-b5a0-a20802e2b9cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-bw5sh\" (UID: \"d3d58457-f9df-4a93-b5a0-a20802e2b9cf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:46:06.898146 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.898116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:06.898307 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.898170 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:06.898307 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.898243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:46:06.898834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.898792 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-service-ca-bundle\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:06.900747 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.900721 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ce3dca2-270f-47dc-b47a-1ac7c17f041b-metrics-certs\") pod \"router-default-57f4976748-f5s4v\" (UID: \"4ce3dca2-270f-47dc-b47a-1ac7c17f041b\") " pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:06.900851 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.900746 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"image-registry-8664978b5b-jvc8t\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:46:06.998784 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:06.998753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:46:07.001062 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.001041 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16d26c4e-bf87-4cb7-bf2f-b317d5500cc4-metrics-tls\") pod \"dns-default-5v76q\" (UID: \"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4\") " pod="openshift-dns/dns-default-5v76q" Jul 10 14:46:07.059920 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.059869 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6t2vj\"" Jul 10 14:46:07.065018 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.065001 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" Jul 10 14:46:07.066113 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.066094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7rkvf\"" Jul 10 14:46:07.074916 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.074896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:07.082313 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.082289 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xlk8t\"" Jul 10 14:46:07.089778 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.089755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:46:07.171971 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.171943 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgh22" event={"ID":"e12c75e4-7905-4cb1-88df-1bb840f82a81","Type":"ContainerStarted","Data":"82092433f5713d40556090eb22cba0dc501b4b25df5e07f0ecf00e2934d0f31d"} Jul 10 14:46:07.174917 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.174809 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cs6cg" event={"ID":"7c25f2ef-9cec-48f5-9257-84db67d53ff7","Type":"ContainerStarted","Data":"f1a091b3a075d07f1d558f9df23a76320be857b7780eda0a3ac66961a85400db"} Jul 10 14:46:07.174917 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.174883 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cs6cg" event={"ID":"7c25f2ef-9cec-48f5-9257-84db67d53ff7","Type":"ContainerStarted","Data":"45758627220f4c2e113f0531aaccbbda963b554f00f27347a52a38494076838e"} Jul 10 14:46:07.182793 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.182703 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqvz7\"" Jul 10 14:46:07.191058 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.190883 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5v76q" Jul 10 14:46:07.194473 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.194415 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cs6cg" podStartSLOduration=69.055878295 podStartE2EDuration="1m10.194398082s" totalImagesPullingTime="1.138519787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:07.192037981 +0000 UTC m=+70.058468275" watchObservedRunningTime="2026-07-10 14:46:07.194398082 +0000 UTC m=+70.060828377" Jul 10 14:46:07.249141 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.249108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh"] Jul 10 14:46:07.253186 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:07.253140 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3d58457_f9df_4a93_b5a0_a20802e2b9cf.slice/crio-b7938ae8756adb811859623e002009b7cfe9c268faad12a8cfbe69c2b51e1aae WatchSource:0}: Error finding container b7938ae8756adb811859623e002009b7cfe9c268faad12a8cfbe69c2b51e1aae: Status 404 returned error can't find the container with id b7938ae8756adb811859623e002009b7cfe9c268faad12a8cfbe69c2b51e1aae Jul 10 14:46:07.332681 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.332659 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5v76q"] Jul 10 14:46:07.334993 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:07.334958 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d26c4e_bf87_4cb7_bf2f_b317d5500cc4.slice/crio-67b8c59feaf25d7baacbdfd47213ecbae2cf29285d6318394d920040dd8a708d WatchSource:0}: Error finding container 67b8c59feaf25d7baacbdfd47213ecbae2cf29285d6318394d920040dd8a708d: Status 404 returned error can't find the container with id 67b8c59feaf25d7baacbdfd47213ecbae2cf29285d6318394d920040dd8a708d Jul 10 14:46:07.471408 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.471380 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57f4976748-f5s4v"] Jul 10 14:46:07.474408 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:07.474389 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8664978b5b-jvc8t"] Jul 10 14:46:07.474590 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:07.474566 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce3dca2_270f_47dc_b47a_1ac7c17f041b.slice/crio-c497d76e7fa29dbf61aee790d4896e6e07e075e3a8932e56e835714e0425923f WatchSource:0}: Error finding container c497d76e7fa29dbf61aee790d4896e6e07e075e3a8932e56e835714e0425923f: Status 404 returned error can't find the container with id c497d76e7fa29dbf61aee790d4896e6e07e075e3a8932e56e835714e0425923f Jul 10 14:46:07.477718 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:07.477691 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfee07384_d124_4723_a25c_db8c46b1064f.slice/crio-342404787acbe3fb38abe4c9601e4deeb2a04bf2cddf7ffb4bdb435762913cbe WatchSource:0}: Error finding container 342404787acbe3fb38abe4c9601e4deeb2a04bf2cddf7ffb4bdb435762913cbe: Status 404 returned error can't find the container with id 342404787acbe3fb38abe4c9601e4deeb2a04bf2cddf7ffb4bdb435762913cbe Jul 10 14:46:08.181416 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.181374 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" event={"ID":"fee07384-d124-4723-a25c-db8c46b1064f","Type":"ContainerStarted","Data":"359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e"} Jul 10 14:46:08.181883 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.181436 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" event={"ID":"fee07384-d124-4723-a25c-db8c46b1064f","Type":"ContainerStarted","Data":"342404787acbe3fb38abe4c9601e4deeb2a04bf2cddf7ffb4bdb435762913cbe"} Jul 10 14:46:08.181964 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.181890 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:46:08.183586 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.183525 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5v76q" event={"ID":"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4","Type":"ContainerStarted","Data":"67b8c59feaf25d7baacbdfd47213ecbae2cf29285d6318394d920040dd8a708d"} Jul 10 14:46:08.185446 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.185361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57f4976748-f5s4v" event={"ID":"4ce3dca2-270f-47dc-b47a-1ac7c17f041b","Type":"ContainerStarted","Data":"6e0d9fe59830fd6db46079bd14f04538572371ed0ed76b1ee006241d03bf6a00"} Jul 10 14:46:08.185446 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.185403 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57f4976748-f5s4v" event={"ID":"4ce3dca2-270f-47dc-b47a-1ac7c17f041b","Type":"ContainerStarted","Data":"c497d76e7fa29dbf61aee790d4896e6e07e075e3a8932e56e835714e0425923f"} Jul 10 14:46:08.188441 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.188391 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" event={"ID":"d3d58457-f9df-4a93-b5a0-a20802e2b9cf","Type":"ContainerStarted","Data":"b7938ae8756adb811859623e002009b7cfe9c268faad12a8cfbe69c2b51e1aae"} Jul 10 14:46:08.209807 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.209761 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" podStartSLOduration=70.209746903 podStartE2EDuration="1m10.209746903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:08.208338466 +0000 UTC m=+71.074768759" watchObservedRunningTime="2026-07-10 14:46:08.209746903 +0000 UTC m=+71.076177174" Jul 10 14:46:08.229195 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.229161 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57f4976748-f5s4v" podStartSLOduration=52.229150442 podStartE2EDuration="52.229150442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:08.228129035 +0000 UTC m=+71.094559329" watchObservedRunningTime="2026-07-10 14:46:08.229150442 +0000 UTC m=+71.095580793" Jul 10 14:46:08.956434 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.956264 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dngbl"] Jul 10 14:46:08.959290 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.959257 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:08.963906 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.963879 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rttgh\"" Jul 10 14:46:08.964039 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.963935 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 10 14:46:08.964115 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.963884 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 10 14:46:08.966689 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.966666 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd"] Jul 10 14:46:08.969141 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.969114 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd"] Jul 10 14:46:08.969553 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.969531 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:08.972051 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.972031 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm"] Jul 10 14:46:08.972224 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.972147 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:08.973623 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.973601 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 10 14:46:08.973950 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.973922 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 14:46:08.974262 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.974236 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 14:46:08.974567 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.974393 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 14:46:08.974567 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.974433 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-htrh6\"" Jul 10 14:46:08.974567 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.974475 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:08.976122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.975527 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 10 14:46:08.976122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.975761 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 10 14:46:08.976122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.975768 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dngbl"] Jul 10 14:46:08.976122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.975959 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 10 14:46:08.976122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.975972 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 10 14:46:08.977311 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:08.977247 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 10 14:46:09.003173 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.003139 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm"] Jul 10 14:46:09.004080 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.004055 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd"] Jul 10 14:46:09.019509 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.019464 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58d4c9fa-2a14-4269-8445-26c260e0fe5b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dngbl\" (UID: \"58d4c9fa-2a14-4269-8445-26c260e0fe5b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:09.019610 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.019533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/58d4c9fa-2a14-4269-8445-26c260e0fe5b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dngbl\" (UID: \"58d4c9fa-2a14-4269-8445-26c260e0fe5b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:09.051268 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.051241 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd"] Jul 10 14:46:09.076125 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.076096 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:09.078591 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.078554 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:09.120334 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120306 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-hub\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.120472 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.120472 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-ca\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.120472 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120429 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50acbecd-2d3c-492b-89b1-a7e18cf6450b-tmp\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.120640 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58d4c9fa-2a14-4269-8445-26c260e0fe5b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dngbl\" (UID: \"58d4c9fa-2a14-4269-8445-26c260e0fe5b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:09.120640 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120524 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg85b\" (UniqueName: \"kubernetes.io/projected/ae58bead-8449-4134-aa17-2ce77abe392d-kube-api-access-pg85b\") pod \"managed-serviceaccount-addon-agent-68fdb46788-dc7hd\" (UID: \"ae58bead-8449-4134-aa17-2ce77abe392d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:09.120640 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbzl4\" (UniqueName: \"kubernetes.io/projected/50acbecd-2d3c-492b-89b1-a7e18cf6450b-kube-api-access-kbzl4\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.120640 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.120640 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120630 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/58d4c9fa-2a14-4269-8445-26c260e0fe5b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dngbl\" (UID: \"58d4c9fa-2a14-4269-8445-26c260e0fe5b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:09.120853 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae58bead-8449-4134-aa17-2ce77abe392d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68fdb46788-dc7hd\" (UID: \"ae58bead-8449-4134-aa17-2ce77abe392d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:09.120853 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120678 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.120853 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50acbecd-2d3c-492b-89b1-a7e18cf6450b-klusterlet-config\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.120853 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.120735 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k4ff\" (UniqueName: \"kubernetes.io/projected/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-kube-api-access-7k4ff\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.121504 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.121472 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/58d4c9fa-2a14-4269-8445-26c260e0fe5b-nginx-conf\") pod \"networking-console-plugin-6cf856758c-dngbl\" (UID: \"58d4c9fa-2a14-4269-8445-26c260e0fe5b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:09.123710 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.123689 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/58d4c9fa-2a14-4269-8445-26c260e0fe5b-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-dngbl\" (UID: \"58d4c9fa-2a14-4269-8445-26c260e0fe5b\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:09.193306 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.193216 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:09.194970 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.194945 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57f4976748-f5s4v" Jul 10 14:46:09.221923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221690 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.221923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae58bead-8449-4134-aa17-2ce77abe392d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68fdb46788-dc7hd\" (UID: \"ae58bead-8449-4134-aa17-2ce77abe392d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:09.221923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.221923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50acbecd-2d3c-492b-89b1-a7e18cf6450b-klusterlet-config\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.221923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221845 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k4ff\" (UniqueName: \"kubernetes.io/projected/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-kube-api-access-7k4ff\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.221923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-hub\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.221923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221913 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.222300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221947 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-ca\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.222300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.221970 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50acbecd-2d3c-492b-89b1-a7e18cf6450b-tmp\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.222300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.222025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg85b\" (UniqueName: \"kubernetes.io/projected/ae58bead-8449-4134-aa17-2ce77abe392d-kube-api-access-pg85b\") pod \"managed-serviceaccount-addon-agent-68fdb46788-dc7hd\" (UID: \"ae58bead-8449-4134-aa17-2ce77abe392d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:09.222300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.222056 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbzl4\" (UniqueName: \"kubernetes.io/projected/50acbecd-2d3c-492b-89b1-a7e18cf6450b-kube-api-access-kbzl4\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.223340 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.222985 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50acbecd-2d3c-492b-89b1-a7e18cf6450b-tmp\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.223340 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.223169 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.225241 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.225200 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.225963 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.225882 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:09.226585 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.226521 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.227063 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.227015 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ae58bead-8449-4134-aa17-2ce77abe392d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-68fdb46788-dc7hd\" (UID: \"ae58bead-8449-4134-aa17-2ce77abe392d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:09.227851 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.227785 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/50acbecd-2d3c-492b-89b1-a7e18cf6450b-klusterlet-config\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.228345 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.228307 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-ca\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.228814 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.228774 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-hub\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.277907 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.277351 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k4ff\" (UniqueName: \"kubernetes.io/projected/8b9db334-1bc1-42ac-a35f-f88c3e52ca71-kube-api-access-7k4ff\") pod \"cluster-proxy-proxy-agent-6455dbdcd8-pprsd\" (UID: \"8b9db334-1bc1-42ac-a35f-f88c3e52ca71\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.280165 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.279961 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" Jul 10 14:46:09.281164 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.281122 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg85b\" (UniqueName: \"kubernetes.io/projected/ae58bead-8449-4134-aa17-2ce77abe392d-kube-api-access-pg85b\") pod \"managed-serviceaccount-addon-agent-68fdb46788-dc7hd\" (UID: \"ae58bead-8449-4134-aa17-2ce77abe392d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:09.284425 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.284385 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbzl4\" (UniqueName: \"kubernetes.io/projected/50acbecd-2d3c-492b-89b1-a7e18cf6450b-kube-api-access-kbzl4\") pod \"klusterlet-addon-workmgr-66f7b5cfcc-8wnkm\" (UID: \"50acbecd-2d3c-492b-89b1-a7e18cf6450b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.307122 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.306868 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" Jul 10 14:46:09.316002 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.315982 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" Jul 10 14:46:09.323000 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.322980 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:09.392354 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.392265 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:09.487543 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.487469 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:09.617648 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.617612 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:09.717733 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.717696 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:09.811595 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.811514 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:09.902301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:09.902249 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:10.459432 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:10.459391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:10.545254 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:10.545219 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:10.640031 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:10.639999 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:11.271602 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:11.271569 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:11.373772 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:11.373732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:11.679394 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:11.679359 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:11.777175 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:11.777149 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:13.197012 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.196956 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-dngbl"] Jul 10 14:46:13.199929 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:13.199786 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d4c9fa_2a14_4269_8445_26c260e0fe5b.slice/crio-5361248e9120afe08bc68148156ecc2c3fde2260337cb3d3632208e68c3bb7e8 WatchSource:0}: Error finding container 5361248e9120afe08bc68148156ecc2c3fde2260337cb3d3632208e68c3bb7e8: Status 404 returned error can't find the container with id 5361248e9120afe08bc68148156ecc2c3fde2260337cb3d3632208e68c3bb7e8 Jul 10 14:46:13.207761 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.207734 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd"] Jul 10 14:46:13.212182 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:13.212155 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b9db334_1bc1_42ac_a35f_f88c3e52ca71.slice/crio-19460324e7a1a958f1b5b0feac2055036d67b5707728e057891c6c45f3323903 WatchSource:0}: Error finding container 19460324e7a1a958f1b5b0feac2055036d67b5707728e057891c6c45f3323903: Status 404 returned error can't find the container with id 19460324e7a1a958f1b5b0feac2055036d67b5707728e057891c6c45f3323903 Jul 10 14:46:13.213882 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.213722 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" event={"ID":"58d4c9fa-2a14-4269-8445-26c260e0fe5b","Type":"ContainerStarted","Data":"5361248e9120afe08bc68148156ecc2c3fde2260337cb3d3632208e68c3bb7e8"} Jul 10 14:46:13.430762 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.430694 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd"] Jul 10 14:46:13.432241 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.432220 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm"] Jul 10 14:46:13.433124 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:13.433103 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50acbecd_2d3c_492b_89b1_a7e18cf6450b.slice/crio-68b3c31e81a93bb2440985cc8c8b7e449846f479742fa46388a3ad00e6aff498 WatchSource:0}: Error finding container 68b3c31e81a93bb2440985cc8c8b7e449846f479742fa46388a3ad00e6aff498: Status 404 returned error can't find the container with id 68b3c31e81a93bb2440985cc8c8b7e449846f479742fa46388a3ad00e6aff498 Jul 10 14:46:13.434162 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:13.434126 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae58bead_8449_4134_aa17_2ce77abe392d.slice/crio-2aac575b6b3e8d5f7315464716da4a6016a5c3501de8bbadd32a36a12cce3e6b WatchSource:0}: Error finding container 2aac575b6b3e8d5f7315464716da4a6016a5c3501de8bbadd32a36a12cce3e6b: Status 404 returned error can't find the container with id 2aac575b6b3e8d5f7315464716da4a6016a5c3501de8bbadd32a36a12cce3e6b Jul 10 14:46:13.499026 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.499003 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:13.594476 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.594417 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:13.707968 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.707940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:13.790292 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:13.790271 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:14.222062 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.222023 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hp7mt" event={"ID":"cf80ce30-07ad-4e45-988b-735088a856b2","Type":"ContainerStarted","Data":"19027229cb1c9d943141c65c0757d3f95315c6af48431bb0ded9825a66f998c5"} Jul 10 14:46:14.223383 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.223362 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" event={"ID":"d3d58457-f9df-4a93-b5a0-a20802e2b9cf","Type":"ContainerStarted","Data":"564a1d5e387d407b763d818be204dbc6a3feee20418af90169f34705c60c10b3"} Jul 10 14:46:14.224381 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.224362 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" event={"ID":"8b9db334-1bc1-42ac-a35f-f88c3e52ca71","Type":"ContainerStarted","Data":"19460324e7a1a958f1b5b0feac2055036d67b5707728e057891c6c45f3323903"} Jul 10 14:46:14.226131 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.226104 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bgh22" event={"ID":"e12c75e4-7905-4cb1-88df-1bb840f82a81","Type":"ContainerStarted","Data":"c9f8e6625f4196ebacdeecc3e07593b0704fea4ff862a34f45b07d64aa1023cd"} Jul 10 14:46:14.231771 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.231750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5v76q" event={"ID":"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4","Type":"ContainerStarted","Data":"2513b081eada18008f6642c48908db166569f826d888709306a43969c05ec777"} Jul 10 14:46:14.231854 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.231838 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5v76q" event={"ID":"16d26c4e-bf87-4cb7-bf2f-b317d5500cc4","Type":"ContainerStarted","Data":"320f648058baabee34c8e29f1a811674610f3ef2465264ebd6435edc184aff74"} Jul 10 14:46:14.231917 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.231861 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5v76q" Jul 10 14:46:14.232788 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.232766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" event={"ID":"50acbecd-2d3c-492b-89b1-a7e18cf6450b","Type":"ContainerStarted","Data":"68b3c31e81a93bb2440985cc8c8b7e449846f479742fa46388a3ad00e6aff498"} Jul 10 14:46:14.233642 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.233625 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" event={"ID":"ae58bead-8449-4134-aa17-2ce77abe392d","Type":"ContainerStarted","Data":"2aac575b6b3e8d5f7315464716da4a6016a5c3501de8bbadd32a36a12cce3e6b"} Jul 10 14:46:14.268839 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.268784 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hp7mt" podStartSLOduration=68.444010748 podStartE2EDuration="1m16.268773007s" totalImagesPullingTime="7.824762259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:14.246238744 +0000 UTC m=+77.112669038" watchObservedRunningTime="2026-07-10 14:46:14.268773007 +0000 UTC m=+77.135203300" Jul 10 14:46:14.269073 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.269052 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5v76q" podStartSLOduration=34.593640731 podStartE2EDuration="40.269047752s" totalImagesPullingTime="5.675407021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:14.267304832 +0000 UTC m=+77.133735150" watchObservedRunningTime="2026-07-10 14:46:14.269047752 +0000 UTC m=+77.135478044" Jul 10 14:46:14.285139 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.285102 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-bw5sh" podStartSLOduration=52.526147707 podStartE2EDuration="58.285087273s" totalImagesPullingTime="5.758939566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:14.28479189 +0000 UTC m=+77.151222183" watchObservedRunningTime="2026-07-10 14:46:14.285087273 +0000 UTC m=+77.151517589" Jul 10 14:46:14.308389 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.307999 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bgh22" podStartSLOduration=18.347818926 podStartE2EDuration="30.307984477s" totalImagesPullingTime="11.960165551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:45:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:14.306797777 +0000 UTC m=+77.173228082" watchObservedRunningTime="2026-07-10 14:46:14.307984477 +0000 UTC m=+77.174414772" Jul 10 14:46:14.780299 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.780202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:14.847096 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:14.847045 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:15.522430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:15.522390 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:15.635983 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:15.635804 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:15.767887 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:15.767811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:15.869030 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:15.868953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:17.248893 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:17.248855 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" event={"ID":"58d4c9fa-2a14-4269-8445-26c260e0fe5b","Type":"ContainerStarted","Data":"57c25d37ef4d6e19bf61fbcdb478ff6d58efb37705fd382620cfabddf7168342"} Jul 10 14:46:17.267242 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:17.267197 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-dngbl" podStartSLOduration=6.1804119459999995 podStartE2EDuration="9.267181617s" totalImagesPullingTime="3.086769671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:17.265606006 +0000 UTC m=+80.132036302" watchObservedRunningTime="2026-07-10 14:46:17.267181617 +0000 UTC m=+80.133611909" Jul 10 14:46:17.315012 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:17.314927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:17.398445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:17.398410 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:17.469681 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:17.469635 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:17.803922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:17.803890 2572 scope.go:117] "RemoveContainer" containerID="f10e184c8531610453fca23cbfd987eada28e96b3b84b7de603937fca5b8ef37" Jul 10 14:46:17.804124 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:46:17.804094 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-mxf5k_openshift-console-operator(39a791a9-9f83-40a1-af78-f63ebea452b6)\"" pod="openshift-console-operator/console-operator-7866497494-mxf5k" podUID="39a791a9-9f83-40a1-af78-f63ebea452b6" Jul 10 14:46:18.723072 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:18.723027 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:18.824404 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:18.824363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:18.987763 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:18.987668 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:19.258739 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.258706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" event={"ID":"8b9db334-1bc1-42ac-a35f-f88c3e52ca71","Type":"ContainerStarted","Data":"219ae55e7328dad18ac7cd94ed88bbff6543cd5defcbdadc77f4bf9fc69fa8bd"} Jul 10 14:46:19.258872 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.258750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" event={"ID":"8b9db334-1bc1-42ac-a35f-f88c3e52ca71","Type":"ContainerStarted","Data":"00e1295d258ad0ad8f8313b6dc746ddfa06551183cdc4563705082940fb5ad1a"} Jul 10 14:46:19.258872 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.258769 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" event={"ID":"8b9db334-1bc1-42ac-a35f-f88c3e52ca71","Type":"ContainerStarted","Data":"40f4ec84e1490531c63f0986c28d300128e4d26c2dd0b843f00bd5bc0c30e155"} Jul 10 14:46:19.260198 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.260173 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" event={"ID":"50acbecd-2d3c-492b-89b1-a7e18cf6450b","Type":"ContainerStarted","Data":"1ae52af104f0778ebee374e3e3ce95352ed64100032d102897bcc2dc863df349"} Jul 10 14:46:19.260395 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.260352 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:19.261645 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.261621 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" event={"ID":"ae58bead-8449-4134-aa17-2ce77abe392d","Type":"ContainerStarted","Data":"a7aac4096632772ee49cf647fc405f1b2339829e2f427c58279e35f641a49045"} Jul 10 14:46:19.262079 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.262063 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" Jul 10 14:46:19.330278 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.330234 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6455dbdcd8-pprsd" podStartSLOduration=5.478442702 podStartE2EDuration="11.330220854s" totalImagesPullingTime="5.851778152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:19.295812826 +0000 UTC m=+82.162243129" watchObservedRunningTime="2026-07-10 14:46:19.330220854 +0000 UTC m=+82.196651147" Jul 10 14:46:19.330568 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.330543 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-66f7b5cfcc-8wnkm" podStartSLOduration=5.688545595 podStartE2EDuration="11.330536389s" totalImagesPullingTime="5.641990794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:19.326240298 +0000 UTC m=+82.192670590" watchObservedRunningTime="2026-07-10 14:46:19.330536389 +0000 UTC m=+82.196966681" Jul 10 14:46:19.365237 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:19.365198 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-68fdb46788-dc7hd" podStartSLOduration=5.746178534 podStartE2EDuration="11.365188797s" totalImagesPullingTime="5.619010263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:19.365052841 +0000 UTC m=+82.231483152" watchObservedRunningTime="2026-07-10 14:46:19.365188797 +0000 UTC m=+82.231619088" Jul 10 14:46:22.601551 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:22.601433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:22.696768 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:22.696739 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:22.803752 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:22.803703 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:22.970448 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:22.970421 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:23.066416 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:23.066374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:24.241098 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:24.241068 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5v76q" Jul 10 14:46:24.889439 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:24.889407 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:25.118993 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.118955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:25.193520 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.193441 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-576jt"] Jul 10 14:46:25.196783 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.196763 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.205420 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.205404 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 14:46:25.205624 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.205608 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-msnxv\"" Jul 10 14:46:25.206311 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.206292 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 14:46:25.206409 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.206392 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 14:46:25.206461 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.206445 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 14:46:25.265602 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.265573 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:25.343958 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.343934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-sys\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.343966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1b8871-5504-40bf-9a01-61b4b8eccd54-metrics-client-ca\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.344005 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-root\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.344035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-accelerators-collector-config\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344189 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.344074 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-wtmp\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344189 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.344154 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-tls\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344276 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.344201 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344318 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.344279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-textfile\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.344318 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.344309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqjzq\" (UniqueName: \"kubernetes.io/projected/1b1b8871-5504-40bf-9a01-61b4b8eccd54-kube-api-access-pqjzq\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.402073 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.402044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:25.444995 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.444941 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-wtmp\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.444995 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.444978 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-tls\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445154 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445014 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445154 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-textfile\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445154 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445064 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqjzq\" (UniqueName: \"kubernetes.io/projected/1b1b8871-5504-40bf-9a01-61b4b8eccd54-kube-api-access-pqjzq\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445154 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445099 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-sys\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445154 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445113 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-wtmp\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445154 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1b8871-5504-40bf-9a01-61b4b8eccd54-metrics-client-ca\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445176 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-root\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445203 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-accelerators-collector-config\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445214 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-sys\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445266 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b1b8871-5504-40bf-9a01-61b4b8eccd54-root\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445615 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445436 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-textfile\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445726 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445700 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-accelerators-collector-config\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.445850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.445736 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b1b8871-5504-40bf-9a01-61b4b8eccd54-metrics-client-ca\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.447428 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.447410 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-tls\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.447544 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.447496 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b1b8871-5504-40bf-9a01-61b4b8eccd54-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.454995 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.454975 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqjzq\" (UniqueName: \"kubernetes.io/projected/1b1b8871-5504-40bf-9a01-61b4b8eccd54-kube-api-access-pqjzq\") pod \"node-exporter-576jt\" (UID: \"1b1b8871-5504-40bf-9a01-61b4b8eccd54\") " pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.498858 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.498805 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:25.505751 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.505734 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-576jt" Jul 10 14:46:25.515714 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:46:25.515690 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1b8871_5504_40bf_9a01_61b4b8eccd54.slice/crio-d63b389c88a3708c64144c9a081f468d688765bf3f38fc54e732f4a5a55fab5e WatchSource:0}: Error finding container d63b389c88a3708c64144c9a081f468d688765bf3f38fc54e732f4a5a55fab5e: Status 404 returned error can't find the container with id d63b389c88a3708c64144c9a081f468d688765bf3f38fc54e732f4a5a55fab5e Jul 10 14:46:25.598564 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:25.598523 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:26.116414 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:26.116366 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:26.200201 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:26.200164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:26.277031 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:26.277001 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:26.288355 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:26.288328 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-576jt" event={"ID":"1b1b8871-5504-40bf-9a01-61b4b8eccd54","Type":"ContainerStarted","Data":"d63b389c88a3708c64144c9a081f468d688765bf3f38fc54e732f4a5a55fab5e"} Jul 10 14:46:26.612161 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:26.612131 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:27.093788 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:27.093749 2572 patch_prober.go:28] interesting pod/image-registry-8664978b5b-jvc8t container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 14:46:27.093956 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:27.093807 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" podUID="fee07384-d124-4723-a25c-db8c46b1064f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:46:27.293316 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:27.293284 2572 generic.go:356] "Generic (PLEG): container finished" podID="1b1b8871-5504-40bf-9a01-61b4b8eccd54" containerID="71876c9e48722e2379861e276d9c4f9d854b4c060d85d58e8794669a13741c78" exitCode=0 Jul 10 14:46:27.293668 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:27.293347 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-576jt" event={"ID":"1b1b8871-5504-40bf-9a01-61b4b8eccd54","Type":"ContainerDied","Data":"71876c9e48722e2379861e276d9c4f9d854b4c060d85d58e8794669a13741c78"} Jul 10 14:46:28.143656 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.143622 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:28.248630 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.248596 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:28.299453 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.299422 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-576jt" event={"ID":"1b1b8871-5504-40bf-9a01-61b4b8eccd54","Type":"ContainerStarted","Data":"2004b3192242f125e92c71123e9a1760383e57fc062da1b1bfa8896f3ded2308"} Jul 10 14:46:28.299855 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.299484 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-576jt" event={"ID":"1b1b8871-5504-40bf-9a01-61b4b8eccd54","Type":"ContainerStarted","Data":"cec766eb452c47b727199bcfa73fe855ee5a735f7a25841446129c6cbd7fb6d3"} Jul 10 14:46:28.322174 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.322137 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-576jt" podStartSLOduration=2.144086887 podStartE2EDuration="3.322125325s" totalImagesPullingTime="1.115120245s" totalInitContainerRuntime="62.918193ms" isStatefulPod=true podCreationTimestamp="2026-07-10 14:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:28.320870683 +0000 UTC m=+91.187300977" watchObservedRunningTime="2026-07-10 14:46:28.322125325 +0000 UTC m=+91.188555616" Jul 10 14:46:28.475938 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.475876 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:28.575232 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.575213 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:28.728456 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.728381 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:28.799109 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:28.799090 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:29.197973 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:29.197950 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:46:29.587469 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:29.587375 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:29.690295 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:29.690263 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:29.921313 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:29.921277 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:30.074102 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:30.074055 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:30.171302 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:30.171268 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:31.452089 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:31.452057 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:31.734086 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:31.734011 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8664978b5b-jvc8t"] Jul 10 14:46:31.801528 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:31.801499 2572 scope.go:117] "RemoveContainer" containerID="f10e184c8531610453fca23cbfd987eada28e96b3b84b7de603937fca5b8ef37" Jul 10 14:46:31.831906 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:31.831881 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:31.934174 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:31.934145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:32.317224 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.317199 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:46:32.317372 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.317314 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mxf5k" event={"ID":"39a791a9-9f83-40a1-af78-f63ebea452b6","Type":"ContainerStarted","Data":"2792ba4db4821961836c590863a1ea18ce39031999e3a3c4a395899245f03f81"} Jul 10 14:46:32.317599 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.317571 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:46:32.325541 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.325500 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-mxf5k" Jul 10 14:46:32.338981 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.338192 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-mxf5k" podStartSLOduration=61.200236058 podStartE2EDuration="1m8.338171198s" totalImagesPullingTime="7.13793514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:32.337041005 +0000 UTC m=+95.203471317" watchObservedRunningTime="2026-07-10 14:46:32.338171198 +0000 UTC m=+95.204601494" Jul 10 14:46:32.521244 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.521205 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:32.617791 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.617707 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:32.715111 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.715074 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:32.794855 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:32.794806 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:33.200438 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:33.200405 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:33.394181 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:33.394151 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:33.504710 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:33.504638 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:33.602537 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:33.602513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:34.040377 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:34.040333 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:34.167158 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:34.167123 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:34.240834 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:34.240802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:34.571024 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:34.570991 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:35.124511 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:35.124475 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:35.226803 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:35.226774 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:35.612989 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:35.612942 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:35.722763 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:35.722742 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:36.525418 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:36.525367 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:36.600796 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:36.600748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:37.177247 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:37.177218 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2pjg8" Jul 10 14:46:39.293123 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:39.293080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:39.409303 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:39.409275 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:39.825546 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:39.825511 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:39.921408 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:39.921379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:42.587173 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:42.587137 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:42.758911 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:42.758877 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:45.761655 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:45.761618 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:45.842305 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:45.842272 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:46.051987 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:46.051913 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:46.152195 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:46.152165 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:48.634836 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:48.634786 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:48.701171 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:48.701145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:49.383148 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:49.383121 2572 generic.go:356] "Generic (PLEG): container finished" podID="1d032ff4-1c76-47a0-8299-8dfa58ca6bf8" containerID="97927a69a9771dd4216a2ec07b6d77ed781283915780cc659a2ae055679bc3ca" exitCode=0 Jul 10 14:46:49.383262 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:49.383196 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" event={"ID":"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8","Type":"ContainerDied","Data":"97927a69a9771dd4216a2ec07b6d77ed781283915780cc659a2ae055679bc3ca"} Jul 10 14:46:49.383501 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:49.383488 2572 scope.go:117] "RemoveContainer" containerID="97927a69a9771dd4216a2ec07b6d77ed781283915780cc659a2ae055679bc3ca" Jul 10 14:46:50.389014 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:50.388975 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-fgr4v" event={"ID":"1d032ff4-1c76-47a0-8299-8dfa58ca6bf8","Type":"ContainerStarted","Data":"1c08108fcc234e60587a79026dc516ef5b001b3b618ce892d82238dfe83d66c6"} Jul 10 14:46:52.801788 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:52.801751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:52.873989 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:52.873960 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:56.753597 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:56.753532 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" podUID="fee07384-d124-4723-a25c-db8c46b1064f" containerName="registry" containerID="cri-o://359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e" gracePeriod=30 Jul 10 14:46:56.996777 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:56.996753 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:46:57.015046 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.014995 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:57.113464 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.113427 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:46:57.173410 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173387 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-registry-certificates\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173560 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173423 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-installation-pull-secrets\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173560 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173443 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-image-registry-private-configuration\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173560 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173477 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fee07384-d124-4723-a25c-db8c46b1064f-ca-trust-extracted\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173727 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173607 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-bound-sa-token\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173727 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173664 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173727 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173706 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6bwq\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-kube-api-access-l6bwq\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173906 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173775 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-trusted-ca\") pod \"fee07384-d124-4723-a25c-db8c46b1064f\" (UID: \"fee07384-d124-4723-a25c-db8c46b1064f\") " Jul 10 14:46:57.173906 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.173856 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:46:57.174064 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.174047 2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-registry-certificates\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.174299 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.174262 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:46:57.176280 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.176236 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:46:57.176469 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.176448 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:46:57.176578 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.176557 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:46:57.176649 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.176624 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:46:57.176768 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.176747 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-kube-api-access-l6bwq" (OuterVolumeSpecName: "kube-api-access-l6bwq") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "kube-api-access-l6bwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:46:57.182438 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.182417 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fee07384-d124-4723-a25c-db8c46b1064f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fee07384-d124-4723-a25c-db8c46b1064f" (UID: "fee07384-d124-4723-a25c-db8c46b1064f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:46:57.274922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.274852 2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-bound-sa-token\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.274922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.274877 2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-registry-tls\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.274922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.274885 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6bwq\" (UniqueName: \"kubernetes.io/projected/fee07384-d124-4723-a25c-db8c46b1064f-kube-api-access-l6bwq\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.274922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.274895 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fee07384-d124-4723-a25c-db8c46b1064f-trusted-ca\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.274922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.274904 2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-installation-pull-secrets\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.274922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.274913 2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fee07384-d124-4723-a25c-db8c46b1064f-image-registry-private-configuration\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.274922 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.274922 2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fee07384-d124-4723-a25c-db8c46b1064f-ca-trust-extracted\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:46:57.416420 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.416385 2572 generic.go:356] "Generic (PLEG): container finished" podID="fee07384-d124-4723-a25c-db8c46b1064f" containerID="359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e" exitCode=0 Jul 10 14:46:57.416603 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.416429 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" Jul 10 14:46:57.416603 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.416480 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" event={"ID":"fee07384-d124-4723-a25c-db8c46b1064f","Type":"ContainerDied","Data":"359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e"} Jul 10 14:46:57.416603 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.416539 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8664978b5b-jvc8t" event={"ID":"fee07384-d124-4723-a25c-db8c46b1064f","Type":"ContainerDied","Data":"342404787acbe3fb38abe4c9601e4deeb2a04bf2cddf7ffb4bdb435762913cbe"} Jul 10 14:46:57.416603 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.416566 2572 scope.go:117] "RemoveContainer" containerID="359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e" Jul 10 14:46:57.425651 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.425634 2572 scope.go:117] "RemoveContainer" containerID="359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e" Jul 10 14:46:57.425964 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:46:57.425941 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e\": container with ID starting with 359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e not found: ID does not exist" containerID="359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e" Jul 10 14:46:57.426014 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.425972 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e"} err="failed to get container status \"359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e\": rpc error: code = NotFound desc = could not find container \"359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e\": container with ID starting with 359253c49a3f8bd7e3077c86875c5d6781b2e376af2ace0eb16cde666a38cf1e not found: ID does not exist" Jul 10 14:46:57.438811 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.438785 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8664978b5b-jvc8t"] Jul 10 14:46:57.444078 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.444060 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8664978b5b-jvc8t"] Jul 10 14:46:57.807721 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:57.807649 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fee07384-d124-4723-a25c-db8c46b1064f" path="/var/lib/kubelet/pods/fee07384-d124-4723-a25c-db8c46b1064f/volumes" Jul 10 14:46:58.422064 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:58.422032 2572 generic.go:356] "Generic (PLEG): container finished" podID="29b0f027-562f-459a-aec1-d732891582e8" containerID="9da33923e23aba35aa7b511e99597dbeffb15de33a32723a2e1e2f9c4bc99dda" exitCode=0 Jul 10 14:46:58.422229 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:58.422082 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" event={"ID":"29b0f027-562f-459a-aec1-d732891582e8","Type":"ContainerDied","Data":"9da33923e23aba35aa7b511e99597dbeffb15de33a32723a2e1e2f9c4bc99dda"} Jul 10 14:46:58.422392 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:58.422379 2572 scope.go:117] "RemoveContainer" containerID="9da33923e23aba35aa7b511e99597dbeffb15de33a32723a2e1e2f9c4bc99dda" Jul 10 14:46:59.427769 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:46:59.427735 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-vn2c5" event={"ID":"29b0f027-562f-459a-aec1-d732891582e8","Type":"ContainerStarted","Data":"279432a9c66ce549e43a4462665afb0e9a83ffe6739bae851bd4afebfb8778d9"} Jul 10 14:47:04.413742 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:04.413707 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:04.480360 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:04.480324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:05.115140 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:05.115101 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:05.215910 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:05.215868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:13.482657 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:13.482629 2572 generic.go:356] "Generic (PLEG): container finished" podID="dd5ada5a-d874-4cd9-89a7-ca7c73126866" containerID="c221edab6a1c0ef530560ab6ceffe042f82cf9aaa69541f838ffb66b2696ea57" exitCode=0 Jul 10 14:47:13.483033 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:13.482689 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" event={"ID":"dd5ada5a-d874-4cd9-89a7-ca7c73126866","Type":"ContainerDied","Data":"c221edab6a1c0ef530560ab6ceffe042f82cf9aaa69541f838ffb66b2696ea57"} Jul 10 14:47:13.483033 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:13.483014 2572 scope.go:117] "RemoveContainer" containerID="c221edab6a1c0ef530560ab6ceffe042f82cf9aaa69541f838ffb66b2696ea57" Jul 10 14:47:14.434876 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:14.434816 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:14.488121 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:14.488090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dlls9" event={"ID":"dd5ada5a-d874-4cd9-89a7-ca7c73126866","Type":"ContainerStarted","Data":"e96ddb8b7e804da862253b93b9c6b46763065f9ebf3255bffc1117755967e635"} Jul 10 14:47:16.077984 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:16.077953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:41.338606 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:41.338567 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:41.409649 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:41.409612 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:48.944881 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:48.944850 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:49.022477 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:49.022440 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:53.232140 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:53.232041 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:47:53.332138 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:47:53.332106 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:00.290104 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:00.290065 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:00.393628 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:00.393598 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:05.119235 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:05.119201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:05.218232 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:05.218201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:20.547935 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:20.547899 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:20.610337 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:20.610306 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:52.527213 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:52.527180 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:48:52.622232 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:48:52.622202 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:19.474678 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:19.474632 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:20.477025 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:20.476912 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:23.286411 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:23.286373 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:23.391004 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:23.390959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:24.830868 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:24.830811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:24.946927 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:24.946894 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:25.583099 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:25.583064 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:25.691431 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:25.691402 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:27.979855 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:27.979802 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:28.171490 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:28.171461 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:30.184249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:30.184198 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:30.283353 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:30.283327 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:34.113700 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:34.113658 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:34.235935 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:34.235910 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:35.559569 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:35.559537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:38.010334 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:38.010284 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:38.102362 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:38.102337 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:44.191967 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:44.191924 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:44.288275 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:44.288253 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:45.928298 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:45.928267 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:57.550238 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:57.550210 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:49:57.553274 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:57.553250 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:49:57.553932 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:57.553914 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:49:57.557346 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:57.557326 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:49:57.561466 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:57.561449 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 14:49:58.006185 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:58.006145 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:59.134118 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.134081 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl"] Jul 10 14:49:59.134463 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.134375 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fee07384-d124-4723-a25c-db8c46b1064f" containerName="registry" Jul 10 14:49:59.134463 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.134386 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fee07384-d124-4723-a25c-db8c46b1064f" containerName="registry" Jul 10 14:49:59.134463 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.134431 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fee07384-d124-4723-a25c-db8c46b1064f" containerName="registry" Jul 10 14:49:59.136299 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.136283 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.140103 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.140083 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 14:49:59.140344 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.140325 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 14:49:59.140596 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.140577 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vh6p9\"" Jul 10 14:49:59.140966 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.140945 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 14:49:59.142908 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.142890 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 14:49:59.206917 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.206892 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl"] Jul 10 14:49:59.266581 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.266551 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fafd72d7-0444-4888-a5a7-5d404e0622d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.266744 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.266595 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fafd72d7-0444-4888-a5a7-5d404e0622d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.266744 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.266620 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fafd72d7-0444-4888-a5a7-5d404e0622d5-manifests\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.266744 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.266639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgxr\" (UniqueName: \"kubernetes.io/projected/fafd72d7-0444-4888-a5a7-5d404e0622d5-kube-api-access-dcgxr\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.266744 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.266659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fafd72d7-0444-4888-a5a7-5d404e0622d5-tmp\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.280569 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.280541 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:59.367163 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.367127 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fafd72d7-0444-4888-a5a7-5d404e0622d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.367163 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.367166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fafd72d7-0444-4888-a5a7-5d404e0622d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.367361 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.367190 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fafd72d7-0444-4888-a5a7-5d404e0622d5-manifests\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.367361 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.367314 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgxr\" (UniqueName: \"kubernetes.io/projected/fafd72d7-0444-4888-a5a7-5d404e0622d5-kube-api-access-dcgxr\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.367361 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.367346 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fafd72d7-0444-4888-a5a7-5d404e0622d5-tmp\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.367627 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.367586 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fafd72d7-0444-4888-a5a7-5d404e0622d5-manifests\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.369445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.369425 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fafd72d7-0444-4888-a5a7-5d404e0622d5-tmp\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.369677 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.369660 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fafd72d7-0444-4888-a5a7-5d404e0622d5-webhook-cert\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.369794 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.369773 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fafd72d7-0444-4888-a5a7-5d404e0622d5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.380804 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.380780 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgxr\" (UniqueName: \"kubernetes.io/projected/fafd72d7-0444-4888-a5a7-5d404e0622d5-kube-api-access-dcgxr\") pod \"opendatahub-operator-controller-manager-666496fd47-vn2bl\" (UID: \"fafd72d7-0444-4888-a5a7-5d404e0622d5\") " pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.387658 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.387626 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:59.447508 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.447475 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:49:59.482254 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.482225 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:59.560560 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.560528 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:59.588851 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.588798 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl"] Jul 10 14:49:59.589477 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:49:59.589450 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafd72d7_0444_4888_a5a7_5d404e0622d5.slice/crio-d5f76b4a2b088d40577c11eff4345b65917bc0360dceb0f4ecd909d5002b4b56 WatchSource:0}: Error finding container d5f76b4a2b088d40577c11eff4345b65917bc0360dceb0f4ecd909d5002b4b56: Status 404 returned error can't find the container with id d5f76b4a2b088d40577c11eff4345b65917bc0360dceb0f4ecd909d5002b4b56 Jul 10 14:49:59.591172 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.591156 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:49:59.697890 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.697771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:49:59.780400 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:49:59.780362 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:00.094156 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:00.094075 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" event={"ID":"fafd72d7-0444-4888-a5a7-5d404e0622d5","Type":"ContainerStarted","Data":"d5f76b4a2b088d40577c11eff4345b65917bc0360dceb0f4ecd909d5002b4b56"} Jul 10 14:50:03.109867 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:03.109813 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" event={"ID":"fafd72d7-0444-4888-a5a7-5d404e0622d5","Type":"ContainerStarted","Data":"9f63a1b8b2736e73da2fb834e39154e8d2849f288f786b11882ce9c99bab19c6"} Jul 10 14:50:04.115517 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:04.115482 2572 generic.go:356] "Generic (PLEG): container finished" podID="fafd72d7-0444-4888-a5a7-5d404e0622d5" containerID="9f63a1b8b2736e73da2fb834e39154e8d2849f288f786b11882ce9c99bab19c6" exitCode=0 Jul 10 14:50:04.115916 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:04.115568 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" event={"ID":"fafd72d7-0444-4888-a5a7-5d404e0622d5","Type":"ContainerDied","Data":"9f63a1b8b2736e73da2fb834e39154e8d2849f288f786b11882ce9c99bab19c6"} Jul 10 14:50:04.180633 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:04.180602 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:04.285010 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:04.284971 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:05.122120 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:05.122033 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" event={"ID":"fafd72d7-0444-4888-a5a7-5d404e0622d5","Type":"ContainerStarted","Data":"9478d7ddc8c1210d3218984640768c5eafc538c18f8646dea265318b92377374"} Jul 10 14:50:05.122457 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:05.122223 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:50:05.153559 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:05.153499 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" podStartSLOduration=1.744192425 podStartE2EDuration="6.15348047s" totalImagesPullingTime="3.40308699s" totalInitContainerRuntime="1.006201055s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:49:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:50:05.151287471 +0000 UTC m=+308.017717767" watchObservedRunningTime="2026-07-10 14:50:05.15348047 +0000 UTC m=+308.019910766" Jul 10 14:50:16.128329 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:16.128294 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-666496fd47-vn2bl" Jul 10 14:50:18.830536 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:18.830490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:18.992923 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:18.992886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:19.301905 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:19.301871 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:19.605527 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:19.605434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:20.016004 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:20.015966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:20.157541 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:20.157501 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:20.262055 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:20.262024 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:20.398249 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:20.398220 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:21.185002 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:21.184960 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:21.479889 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:21.479788 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:21.570736 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:21.570700 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:21.650881 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:21.650851 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:22.889631 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:22.889584 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:26.860489 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:26.860451 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:27.055759 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.055721 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:27.769604 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.769570 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m"] Jul 10 14:50:27.773954 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.773934 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.781574 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.781550 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x8rbj\"" Jul 10 14:50:27.781574 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.781564 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 14:50:27.889465 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889434 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsrrz\" (UniqueName: \"kubernetes.io/projected/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-kube-api-access-hsrrz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889515 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889553 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889593 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889648 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.889846 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.889703 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.946198 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.946160 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:27.959781 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.959436 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m"] Jul 10 14:50:27.990575 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.990540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.990715 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.990593 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.990715 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.990642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.990715 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.990664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.990891 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.990862 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsrrz\" (UniqueName: \"kubernetes.io/projected/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-kube-api-access-hsrrz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.990958 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.990915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991055 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991034 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991145 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991122 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991314 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991295 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991390 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991201 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991445 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991543 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991426 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.991596 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.991577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.993365 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.993344 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:27.993594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:27.993576 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:28.001457 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:28.001429 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:28.005291 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:28.005269 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsrrz\" (UniqueName: \"kubernetes.io/projected/27cda3b1-c886-46cb-bbb9-3d0db6c8afda-kube-api-access-hsrrz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb6789vg7m\" (UID: \"27cda3b1-c886-46cb-bbb9-3d0db6c8afda\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:28.085501 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:28.085447 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:28.222433 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:28.222400 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:28.237321 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:28.237296 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m"] Jul 10 14:50:28.239510 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:50:28.239479 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27cda3b1_c886_46cb_bbb9_3d0db6c8afda.slice/crio-97c808b445c983ed343c2c300185e5049064f1a38e16e6e938cf556411a096bd WatchSource:0}: Error finding container 97c808b445c983ed343c2c300185e5049064f1a38e16e6e938cf556411a096bd: Status 404 returned error can't find the container with id 97c808b445c983ed343c2c300185e5049064f1a38e16e6e938cf556411a096bd Jul 10 14:50:28.503424 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:28.503386 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:29.225136 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.225100 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" event={"ID":"27cda3b1-c886-46cb-bbb9-3d0db6c8afda","Type":"ContainerStarted","Data":"97c808b445c983ed343c2c300185e5049064f1a38e16e6e938cf556411a096bd"} Jul 10 14:50:29.794959 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.794925 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z"] Jul 10 14:50:29.802073 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.802048 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:29.805961 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.805931 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 14:50:29.806078 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.805983 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 14:50:29.807147 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.806920 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:50:29.807147 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.806941 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tj5c7\"" Jul 10 14:50:29.807147 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.807125 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 14:50:29.807589 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.807566 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 14:50:29.811487 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.811155 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z"] Jul 10 14:50:29.907946 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.907911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00803cf8-1650-4b85-8b32-4eed5c140a18-metrics-cert\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:29.908114 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.907995 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvlwk\" (UniqueName: \"kubernetes.io/projected/00803cf8-1650-4b85-8b32-4eed5c140a18-kube-api-access-zvlwk\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:29.908114 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.908042 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00803cf8-1650-4b85-8b32-4eed5c140a18-cert\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:29.908240 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:29.908129 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00803cf8-1650-4b85-8b32-4eed5c140a18-manager-config\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.009172 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.009139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvlwk\" (UniqueName: \"kubernetes.io/projected/00803cf8-1650-4b85-8b32-4eed5c140a18-kube-api-access-zvlwk\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.009352 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.009201 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00803cf8-1650-4b85-8b32-4eed5c140a18-cert\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.009352 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.009247 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00803cf8-1650-4b85-8b32-4eed5c140a18-manager-config\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.009352 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.009292 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00803cf8-1650-4b85-8b32-4eed5c140a18-metrics-cert\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.010065 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.010035 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/00803cf8-1650-4b85-8b32-4eed5c140a18-manager-config\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.012102 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.012067 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/00803cf8-1650-4b85-8b32-4eed5c140a18-metrics-cert\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.012210 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.012188 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00803cf8-1650-4b85-8b32-4eed5c140a18-cert\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.022538 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.022514 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvlwk\" (UniqueName: \"kubernetes.io/projected/00803cf8-1650-4b85-8b32-4eed5c140a18-kube-api-access-zvlwk\") pod \"lws-controller-manager-7cf7d8879d-mh66z\" (UID: \"00803cf8-1650-4b85-8b32-4eed5c140a18\") " pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.115047 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.114972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:30.670548 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.670513 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:50:30.670918 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.670595 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:50:30.670918 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.670641 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:50:30.769536 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.769454 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z"] Jul 10 14:50:30.771672 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:50:30.771646 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00803cf8_1650_4b85_8b32_4eed5c140a18.slice/crio-32170d4e239649f30ccec9a410cb7ba237db84ee3eb97dd0114ddfa4a0a629f8 WatchSource:0}: Error finding container 32170d4e239649f30ccec9a410cb7ba237db84ee3eb97dd0114ddfa4a0a629f8: Status 404 returned error can't find the container with id 32170d4e239649f30ccec9a410cb7ba237db84ee3eb97dd0114ddfa4a0a629f8 Jul 10 14:50:30.907577 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:30.907541 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:31.022549 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:31.022177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:31.236369 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:31.236282 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" event={"ID":"00803cf8-1650-4b85-8b32-4eed5c140a18","Type":"ContainerStarted","Data":"32170d4e239649f30ccec9a410cb7ba237db84ee3eb97dd0114ddfa4a0a629f8"} Jul 10 14:50:31.238207 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:31.238176 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" event={"ID":"27cda3b1-c886-46cb-bbb9-3d0db6c8afda","Type":"ContainerStarted","Data":"2cd845efd763c0c1d97a38badef25e2ef98f05a30a0e2212cfd2415381c1eb53"} Jul 10 14:50:31.238488 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:31.238456 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:31.278257 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:31.278196 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" podStartSLOduration=1.849303707 podStartE2EDuration="4.278174765s" totalImagesPullingTime="2.428871058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:50:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:50:31.272297388 +0000 UTC m=+334.138727693" watchObservedRunningTime="2026-07-10 14:50:31.278174765 +0000 UTC m=+334.144605060" Jul 10 14:50:31.391106 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:31.391036 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:31.528866 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:31.528748 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:32.086481 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:32.086451 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:32.091758 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:32.091733 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:32.242353 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:32.242314 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:32.243446 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:32.243420 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb6789vg7m" Jul 10 14:50:32.321940 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:32.321890 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:50:33.247101 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:33.247066 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" event={"ID":"00803cf8-1650-4b85-8b32-4eed5c140a18","Type":"ContainerStarted","Data":"c387f79eda7f17f5d74e1b8ce6b8c3bf27efd7f385efd7cfee40bbc2a33e31e4"} Jul 10 14:50:33.247479 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:33.247300 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:50:33.286712 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:33.286667 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" podStartSLOduration=1.98952931 podStartE2EDuration="4.286654335s" totalImagesPullingTime="2.297125025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:50:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:50:33.284859282 +0000 UTC m=+336.151289572" watchObservedRunningTime="2026-07-10 14:50:33.286654335 +0000 UTC m=+336.153084626" Jul 10 14:50:44.253419 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:50:44.253385 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cf7d8879d-mh66z" Jul 10 14:51:20.360506 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:20.360405 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:20.458996 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:20.458962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:20.563115 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:20.563075 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:21.270473 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:21.270433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:21.477932 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:21.477897 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:25.381300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:25.381262 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:49.819642 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:49.819600 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:53.360499 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:53.360378 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:54.830615 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:54.830580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:55.210358 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:55.210307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:56.256522 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:56.256489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:56.363081 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:56.363048 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:57.816680 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:57.816641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:57.927748 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:57.927718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:51:58.230800 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:51:58.230764 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:00.016993 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:00.016955 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:01.845228 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:01.845193 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:02.803339 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:02.803302 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:02.904946 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:02.904910 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:03.753017 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:03.752984 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:03.856337 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:03.856307 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:05.035933 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:05.035892 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:05.414254 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:05.414217 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:12.671179 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:12.671139 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:12.836959 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:12.836926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:12.948722 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:12.948636 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:15.249974 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:15.249940 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:15.499319 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:15.499278 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:17.569717 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.569679 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq"] Jul 10 14:52:17.572755 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.572739 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:17.578750 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.578725 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fffgr\"" Jul 10 14:52:17.579311 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.578987 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 14:52:17.583430 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.583414 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 14:52:17.598758 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.598732 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq"] Jul 10 14:52:17.665047 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.665018 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45105a-8a60-431d-a2aa-d1963cb83d37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2zzcq\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:17.665202 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.665092 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75nq\" (UniqueName: \"kubernetes.io/projected/0e45105a-8a60-431d-a2aa-d1963cb83d37-kube-api-access-l75nq\") pod \"kuadrant-operator-controller-manager-86878c769f-2zzcq\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:17.765680 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.765647 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45105a-8a60-431d-a2aa-d1963cb83d37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2zzcq\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:17.765850 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.765700 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75nq\" (UniqueName: \"kubernetes.io/projected/0e45105a-8a60-431d-a2aa-d1963cb83d37-kube-api-access-l75nq\") pod \"kuadrant-operator-controller-manager-86878c769f-2zzcq\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:17.766045 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.766025 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45105a-8a60-431d-a2aa-d1963cb83d37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2zzcq\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:17.776108 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.776085 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75nq\" (UniqueName: \"kubernetes.io/projected/0e45105a-8a60-431d-a2aa-d1963cb83d37-kube-api-access-l75nq\") pod \"kuadrant-operator-controller-manager-86878c769f-2zzcq\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:17.882949 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:17.882873 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:18.038313 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:18.038136 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq"] Jul 10 14:52:18.041137 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:52:18.041111 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e45105a_8a60_431d_a2aa_d1963cb83d37.slice/crio-af78be1640e4d999bdc42955f60400c3f58bba9a603cab2644f11288fb263b2b WatchSource:0}: Error finding container af78be1640e4d999bdc42955f60400c3f58bba9a603cab2644f11288fb263b2b: Status 404 returned error can't find the container with id af78be1640e4d999bdc42955f60400c3f58bba9a603cab2644f11288fb263b2b Jul 10 14:52:18.680548 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:18.680519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" event={"ID":"0e45105a-8a60-431d-a2aa-d1963cb83d37","Type":"ContainerStarted","Data":"af78be1640e4d999bdc42955f60400c3f58bba9a603cab2644f11288fb263b2b"} Jul 10 14:52:19.720428 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:19.720391 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:19.924636 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:19.924595 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:23.520388 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:23.520352 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:23.676600 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:23.676563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:23.705803 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:23.705776 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" event={"ID":"0e45105a-8a60-431d-a2aa-d1963cb83d37","Type":"ContainerStarted","Data":"f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e"} Jul 10 14:52:23.705941 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:23.705889 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:23.743792 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:23.743749 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" podStartSLOduration=1.802151758 podStartE2EDuration="6.743735505s" totalImagesPullingTime="4.941583747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:52:23.741418036 +0000 UTC m=+446.607848334" watchObservedRunningTime="2026-07-10 14:52:23.743735505 +0000 UTC m=+446.610165799" Jul 10 14:52:32.337192 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:32.337152 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:32.460936 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:32.460909 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:32.561999 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:32.561961 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:34.713322 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:34.713292 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 14:52:34.826202 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:34.826170 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:34.923012 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:34.922957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:39.555989 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:39.555951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:39.659995 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:39.659957 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:43.438515 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:43.438480 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:44.019192 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:44.019160 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:44.135093 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:44.135052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:51.476182 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.476149 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8"] Jul 10 14:52:51.479258 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.479238 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.482335 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.482305 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2jqwb\"" Jul 10 14:52:51.513985 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.513959 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8"] Jul 10 14:52:51.538310 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538282 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538427 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538427 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c4dae81-aa2b-4677-b470-5e89309ef985-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538427 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538581 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538460 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7ttv\" (UniqueName: \"kubernetes.io/projected/5c4dae81-aa2b-4677-b470-5e89309ef985-kube-api-access-g7ttv\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538581 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538485 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538581 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538502 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538581 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.538581 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.538537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.541621 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.541599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:51.639917 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.639891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640051 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.639923 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640051 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.639949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c4dae81-aa2b-4677-b470-5e89309ef985-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640051 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.639970 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640051 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.639996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7ttv\" (UniqueName: \"kubernetes.io/projected/5c4dae81-aa2b-4677-b470-5e89309ef985-kube-api-access-g7ttv\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640051 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640030 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640138 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640301 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640218 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640454 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640323 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640454 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640418 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640902 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640595 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.640902 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.640602 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.641041 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.641016 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c4dae81-aa2b-4677-b470-5e89309ef985-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.642281 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.642261 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.642919 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.642900 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.659132 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.659104 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c4dae81-aa2b-4677-b470-5e89309ef985-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.674267 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.674242 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7ttv\" (UniqueName: \"kubernetes.io/projected/5c4dae81-aa2b-4677-b470-5e89309ef985-kube-api-access-g7ttv\") pod \"maas-default-gateway-openshift-default-5896d4dd49-hrzr8\" (UID: \"5c4dae81-aa2b-4677-b470-5e89309ef985\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.789513 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.789454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:51.789990 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.789967 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:51.950573 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.950544 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8"] Jul 10 14:52:51.952726 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:52:51.952703 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4dae81_aa2b_4677_b470_5e89309ef985.slice/crio-efbbce48333459099053a18614dc5ecca386bde89b407aa8ef45ade1a9e5e720 WatchSource:0}: Error finding container efbbce48333459099053a18614dc5ecca386bde89b407aa8ef45ade1a9e5e720: Status 404 returned error can't find the container with id efbbce48333459099053a18614dc5ecca386bde89b407aa8ef45ade1a9e5e720 Jul 10 14:52:51.954658 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.954628 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:52:51.954709 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.954691 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:52:51.954747 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:51.954721 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:52:52.567870 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:52.567813 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:52.737001 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:52.736959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:52.833459 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:52.833370 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" event={"ID":"5c4dae81-aa2b-4677-b470-5e89309ef985","Type":"ContainerStarted","Data":"d5678677eb25d46ca6b484e322b0e47374bdfc5b9d634528e082b5e201e1c82d"} Jul 10 14:52:52.833459 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:52.833428 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" event={"ID":"5c4dae81-aa2b-4677-b470-5e89309ef985","Type":"ContainerStarted","Data":"efbbce48333459099053a18614dc5ecca386bde89b407aa8ef45ade1a9e5e720"} Jul 10 14:52:52.876307 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:52.876260 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" podStartSLOduration=1.876245462 podStartE2EDuration="1.876245462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:52:52.873342407 +0000 UTC m=+475.739772701" watchObservedRunningTime="2026-07-10 14:52:52.876245462 +0000 UTC m=+475.742675755" Jul 10 14:52:53.789839 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:53.789796 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:53.794912 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:53.794886 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:53.837279 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:53.837244 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:53.838114 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:53.838097 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:52:54.332235 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:54.332201 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:54.535565 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:54.535516 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:55.017245 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:55.017210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:55.113961 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:55.113927 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:55.250739 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:55.250706 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:55.355300 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:55.355225 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:59.677657 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:59.677619 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:52:59.781344 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:52:59.781310 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:15.385208 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:15.385164 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:15.505159 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:15.505127 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:15.956514 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:15.956481 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:28.656222 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:28.656185 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:28.745302 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:28.745270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:28.920542 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:28.920464 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c9599b5c6-rtn54"] Jul 10 14:53:28.923868 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:28.923848 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:28.926451 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:28.926432 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mwm6l\"" Jul 10 14:53:28.927611 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:28.927592 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 10 14:53:28.934446 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:28.934419 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c9599b5c6-rtn54"] Jul 10 14:53:29.006913 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.006883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc43350-b512-4e3a-b180-00b345c6dba5-tls-cert\") pod \"authorino-5c9599b5c6-rtn54\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:29.007069 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.006950 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzsns\" (UniqueName: \"kubernetes.io/projected/dbc43350-b512-4e3a-b180-00b345c6dba5-kube-api-access-dzsns\") pod \"authorino-5c9599b5c6-rtn54\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:29.107868 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.107835 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc43350-b512-4e3a-b180-00b345c6dba5-tls-cert\") pod \"authorino-5c9599b5c6-rtn54\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:29.108077 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.107900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzsns\" (UniqueName: \"kubernetes.io/projected/dbc43350-b512-4e3a-b180-00b345c6dba5-kube-api-access-dzsns\") pod \"authorino-5c9599b5c6-rtn54\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:29.110262 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.110229 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc43350-b512-4e3a-b180-00b345c6dba5-tls-cert\") pod \"authorino-5c9599b5c6-rtn54\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:29.117251 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.117227 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzsns\" (UniqueName: \"kubernetes.io/projected/dbc43350-b512-4e3a-b180-00b345c6dba5-kube-api-access-dzsns\") pod \"authorino-5c9599b5c6-rtn54\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:29.232658 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.232571 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:53:29.367908 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.367880 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c9599b5c6-rtn54"] Jul 10 14:53:29.370028 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:53:29.370005 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbc43350_b512_4e3a_b180_00b345c6dba5.slice/crio-67ff38c15cbd59737a81a3a6205f08941d727678ff66501c1abfd60ac20efafc WatchSource:0}: Error finding container 67ff38c15cbd59737a81a3a6205f08941d727678ff66501c1abfd60ac20efafc: Status 404 returned error can't find the container with id 67ff38c15cbd59737a81a3a6205f08941d727678ff66501c1abfd60ac20efafc Jul 10 14:53:29.986813 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:29.986772 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" event={"ID":"dbc43350-b512-4e3a-b180-00b345c6dba5","Type":"ContainerStarted","Data":"67ff38c15cbd59737a81a3a6205f08941d727678ff66501c1abfd60ac20efafc"} Jul 10 14:53:33.003644 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:33.003613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" event={"ID":"dbc43350-b512-4e3a-b180-00b345c6dba5","Type":"ContainerStarted","Data":"c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b"} Jul 10 14:53:33.026123 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:33.026076 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" podStartSLOduration=1.932860923 podStartE2EDuration="5.026060658s" totalImagesPullingTime="3.093199735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:53:33.025132831 +0000 UTC m=+515.891563126" watchObservedRunningTime="2026-07-10 14:53:33.026060658 +0000 UTC m=+515.892490952" Jul 10 14:53:37.998784 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:37.998752 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:38.143521 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:38.143489 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:38.242786 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:38.242757 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:38.336163 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:38.336088 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:41.260935 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:41.260896 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:53:41.375417 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:53:41.375382 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:14.277231 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:14.277149 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:14.794558 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:14.794527 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:15.012779 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:15.012746 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:15.463036 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:15.462999 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:15.599416 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:15.599384 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:23.225561 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:23.225533 2572 generic.go:356] "Generic (PLEG): container finished" podID="5c4dae81-aa2b-4677-b470-5e89309ef985" containerID="d5678677eb25d46ca6b484e322b0e47374bdfc5b9d634528e082b5e201e1c82d" exitCode=0 Jul 10 14:54:23.225912 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:23.225609 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" event={"ID":"5c4dae81-aa2b-4677-b470-5e89309ef985","Type":"ContainerDied","Data":"d5678677eb25d46ca6b484e322b0e47374bdfc5b9d634528e082b5e201e1c82d"} Jul 10 14:54:23.225992 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:23.225979 2572 scope.go:117] "RemoveContainer" containerID="d5678677eb25d46ca6b484e322b0e47374bdfc5b9d634528e082b5e201e1c82d" Jul 10 14:54:23.229386 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:23.229249 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:54:23.229386 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:23.229339 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:54:23.229519 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:23.229404 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 14:54:23.838182 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:23.838151 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:54:24.232667 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:24.232633 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" event={"ID":"5c4dae81-aa2b-4677-b470-5e89309ef985","Type":"ContainerStarted","Data":"ad0832f5d98f58d4ff734034d21f73519bcc3848bf3aa866d85339cd4b4cda60"} Jul 10 14:54:24.790476 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:24.790437 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:54:24.791475 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:24.791449 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hrzr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 10 14:54:24.791583 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:24.791524 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" podUID="5c4dae81-aa2b-4677-b470-5e89309ef985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 10 14:54:25.359548 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:25.359517 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:25.515291 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:25.515259 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:25.790528 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:25.790496 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hrzr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 10 14:54:25.790700 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:25.790547 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" podUID="5c4dae81-aa2b-4677-b470-5e89309ef985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 10 14:54:26.789792 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:26.789762 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hrzr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 10 14:54:26.790198 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:26.789811 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" podUID="5c4dae81-aa2b-4677-b470-5e89309ef985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 10 14:54:27.789842 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:27.789788 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-hrzr8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body= Jul 10 14:54:27.790248 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:27.789862 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" podUID="5c4dae81-aa2b-4677-b470-5e89309ef985" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" Jul 10 14:54:28.794124 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:28.794090 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:54:28.794637 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:28.794612 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:54:28.795289 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:28.795270 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-hrzr8" Jul 10 14:54:29.067273 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.067189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:29.361799 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.361714 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp"] Jul 10 14:54:29.364494 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.364478 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.371419 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.371291 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 14:54:29.371419 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.371360 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 14:54:29.371559 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.371489 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 14:54:29.371559 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.371525 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wk7h7\"" Jul 10 14:54:29.416068 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.416030 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp"] Jul 10 14:54:29.436725 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.436685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:29.478347 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.478310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phncq\" (UniqueName: \"kubernetes.io/projected/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-kube-api-access-phncq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.478347 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.478349 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.478594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.478380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.478594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.478449 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.478594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.478481 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.478594 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.478538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.579393 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579348 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phncq\" (UniqueName: \"kubernetes.io/projected/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-kube-api-access-phncq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.579393 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579406 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.579699 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579444 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.579699 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579469 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.579814 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.579896 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.579953 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579927 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.580008 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.579960 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.580234 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.580214 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.581864 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.581841 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.582238 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.582221 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.593213 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.593191 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phncq\" (UniqueName: \"kubernetes.io/projected/1efb75ca-dadd-45a6-bf24-eeb154aa0bee-kube-api-access-phncq\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp\" (UID: \"1efb75ca-dadd-45a6-bf24-eeb154aa0bee\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.675159 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.675135 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:29.828000 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:29.827965 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp"] Jul 10 14:54:29.828676 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:54:29.828650 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1efb75ca_dadd_45a6_bf24_eeb154aa0bee.slice/crio-cffeba0b5b79ad89e8da5db07613a8a6e3b7fb3caf08b7d58fe821676a36c279 WatchSource:0}: Error finding container cffeba0b5b79ad89e8da5db07613a8a6e3b7fb3caf08b7d58fe821676a36c279: Status 404 returned error can't find the container with id cffeba0b5b79ad89e8da5db07613a8a6e3b7fb3caf08b7d58fe821676a36c279 Jul 10 14:54:30.271955 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:30.271877 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" event={"ID":"1efb75ca-dadd-45a6-bf24-eeb154aa0bee","Type":"ContainerStarted","Data":"cffeba0b5b79ad89e8da5db07613a8a6e3b7fb3caf08b7d58fe821676a36c279"} Jul 10 14:54:31.276198 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:31.276158 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" event={"ID":"1efb75ca-dadd-45a6-bf24-eeb154aa0bee","Type":"ContainerStarted","Data":"ae8034f3c7ae76f82ac9bf1b8500bd510899bbb3efcb7e6f092b1092ce4a05e7"} Jul 10 14:54:31.315189 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:31.315142 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" podStartSLOduration=1.073259057 podStartE2EDuration="2.315126758s" totalImagesPullingTime="1.241867701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:54:31.314531826 +0000 UTC m=+574.180962120" watchObservedRunningTime="2026-07-10 14:54:31.315126758 +0000 UTC m=+574.181557084" Jul 10 14:54:39.675602 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:39.675545 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:39.676076 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:39.675625 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:39.688476 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:39.688448 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:40.326436 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:40.326413 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp" Jul 10 14:54:42.261368 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:42.261338 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:49.099517 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:49.099473 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:49.172040 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:49.172002 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:53.119592 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.119559 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm"] Jul 10 14:54:53.123134 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.123114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.130874 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.130855 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 10 14:54:53.141174 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.141154 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm"] Jul 10 14:54:53.165521 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.165483 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:54:53.267992 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.267955 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f652c39e-5d74-4a5c-a151-693b855f6352-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.268162 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.268004 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.268162 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.268034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.268162 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.268076 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5bf4\" (UniqueName: \"kubernetes.io/projected/f652c39e-5d74-4a5c-a151-693b855f6352-kube-api-access-d5bf4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.268162 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.268138 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.268297 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.268163 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.369655 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.369553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5bf4\" (UniqueName: \"kubernetes.io/projected/f652c39e-5d74-4a5c-a151-693b855f6352-kube-api-access-d5bf4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.369655 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.369636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.369913 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.369669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.369913 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.369731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f652c39e-5d74-4a5c-a151-693b855f6352-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.369913 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.369775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.369913 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.369808 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.370161 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.370101 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.370257 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.370223 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.370494 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.370467 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.372325 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.372294 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f652c39e-5d74-4a5c-a151-693b855f6352-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.372626 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.372605 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f652c39e-5d74-4a5c-a151-693b855f6352-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.379162 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.379136 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5bf4\" (UniqueName: \"kubernetes.io/projected/f652c39e-5d74-4a5c-a151-693b855f6352-kube-api-access-d5bf4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-jvqmm\" (UID: \"f652c39e-5d74-4a5c-a151-693b855f6352\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.433111 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.433083 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:54:53.569496 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:53.569472 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm"] Jul 10 14:54:53.571101 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:54:53.571071 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf652c39e_5d74_4a5c_a151_693b855f6352.slice/crio-ab9b37ae467fc45807285ecaf22027abeb6564059cf8e721493261f1c12cdb87 WatchSource:0}: Error finding container ab9b37ae467fc45807285ecaf22027abeb6564059cf8e721493261f1c12cdb87: Status 404 returned error can't find the container with id ab9b37ae467fc45807285ecaf22027abeb6564059cf8e721493261f1c12cdb87 Jul 10 14:54:54.383242 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:54.383199 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" event={"ID":"f652c39e-5d74-4a5c-a151-693b855f6352","Type":"ContainerStarted","Data":"1df041f61c79a6f6d6f04385d5225c74bbb7a879d04facd38dfc2dd187398c40"} Jul 10 14:54:54.383624 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:54.383263 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" event={"ID":"f652c39e-5d74-4a5c-a151-693b855f6352","Type":"ContainerStarted","Data":"ab9b37ae467fc45807285ecaf22027abeb6564059cf8e721493261f1c12cdb87"} Jul 10 14:54:54.404363 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:54.404308 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" podStartSLOduration=1.21470998 podStartE2EDuration="1.404291497s" totalImagesPullingTime="189.581517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:54:54.40327602 +0000 UTC m=+597.269706314" watchObservedRunningTime="2026-07-10 14:54:54.404291497 +0000 UTC m=+597.270721791" Jul 10 14:54:57.579709 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:57.579680 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:54:57.580181 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:57.580156 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:54:57.583696 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:57.583673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:54:57.584169 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:54:57.584150 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:55:02.533161 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:02.533119 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:55:03.433947 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:03.433915 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:55:03.434147 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:03.433992 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:55:03.446396 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:03.446374 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:55:03.908688 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:03.908652 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:55:04.442533 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:04.442502 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-jvqmm" Jul 10 14:55:15.244043 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:15.244009 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:55:18.098456 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:18.098423 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:55:45.857277 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:55:45.857241 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:56:25.404299 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.404261 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-564d6ffdfc-xz7cb"] Jul 10 14:56:25.407636 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.407612 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.427279 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.427256 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564d6ffdfc-xz7cb"] Jul 10 14:56:25.582448 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.582424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08b96d59-ceb7-46ce-b069-fbb87e1a6323-tls-cert\") pod \"authorino-564d6ffdfc-xz7cb\" (UID: \"08b96d59-ceb7-46ce-b069-fbb87e1a6323\") " pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.582558 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.582468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thn9g\" (UniqueName: \"kubernetes.io/projected/08b96d59-ceb7-46ce-b069-fbb87e1a6323-kube-api-access-thn9g\") pod \"authorino-564d6ffdfc-xz7cb\" (UID: \"08b96d59-ceb7-46ce-b069-fbb87e1a6323\") " pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.683426 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.683363 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08b96d59-ceb7-46ce-b069-fbb87e1a6323-tls-cert\") pod \"authorino-564d6ffdfc-xz7cb\" (UID: \"08b96d59-ceb7-46ce-b069-fbb87e1a6323\") " pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.683426 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.683421 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thn9g\" (UniqueName: \"kubernetes.io/projected/08b96d59-ceb7-46ce-b069-fbb87e1a6323-kube-api-access-thn9g\") pod \"authorino-564d6ffdfc-xz7cb\" (UID: \"08b96d59-ceb7-46ce-b069-fbb87e1a6323\") " pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.686024 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.686000 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08b96d59-ceb7-46ce-b069-fbb87e1a6323-tls-cert\") pod \"authorino-564d6ffdfc-xz7cb\" (UID: \"08b96d59-ceb7-46ce-b069-fbb87e1a6323\") " pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.687048 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.687000 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:56:25.693598 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.693577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thn9g\" (UniqueName: \"kubernetes.io/projected/08b96d59-ceb7-46ce-b069-fbb87e1a6323-kube-api-access-thn9g\") pod \"authorino-564d6ffdfc-xz7cb\" (UID: \"08b96d59-ceb7-46ce-b069-fbb87e1a6323\") " pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.716790 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.716769 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" Jul 10 14:56:25.828877 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.828811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:56:25.872278 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.872253 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-564d6ffdfc-xz7cb"] Jul 10 14:56:25.873883 ip-10-0-133-29 kubenswrapper[2572]: W0710 14:56:25.873859 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08b96d59_ceb7_46ce_b069_fbb87e1a6323.slice/crio-85416cfd61e7e8da635eacb5422c4e5689c51690c7c9f735f921d13c36ca6b22 WatchSource:0}: Error finding container 85416cfd61e7e8da635eacb5422c4e5689c51690c7c9f735f921d13c36ca6b22: Status 404 returned error can't find the container with id 85416cfd61e7e8da635eacb5422c4e5689c51690c7c9f735f921d13c36ca6b22 Jul 10 14:56:25.875079 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:25.875059 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:56:26.817473 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:26.817427 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" event={"ID":"08b96d59-ceb7-46ce-b069-fbb87e1a6323","Type":"ContainerStarted","Data":"8da0b00782f83ddfd2f232094d21ce60b53578b9e1a4b374f5fedf4b5873c8bc"} Jul 10 14:56:26.817959 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:26.817488 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" event={"ID":"08b96d59-ceb7-46ce-b069-fbb87e1a6323","Type":"ContainerStarted","Data":"85416cfd61e7e8da635eacb5422c4e5689c51690c7c9f735f921d13c36ca6b22"} Jul 10 14:56:26.855446 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:26.855379 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-564d6ffdfc-xz7cb" podStartSLOduration=1.488221652 podStartE2EDuration="1.855341455s" totalImagesPullingTime="367.119803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:56:26.853399411 +0000 UTC m=+689.719829701" watchObservedRunningTime="2026-07-10 14:56:26.855341455 +0000 UTC m=+689.721771749" Jul 10 14:56:26.954896 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:26.954855 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:56:26.956179 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:26.956153 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c9599b5c6-rtn54"] Jul 10 14:56:26.956366 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:26.956344 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" podUID="dbc43350-b512-4e3a-b180-00b345c6dba5" containerName="authorino" containerID="cri-o://c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b" gracePeriod=30 Jul 10 14:56:27.086147 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.086113 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:56:27.220861 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.220805 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:56:27.404452 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.404421 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc43350-b512-4e3a-b180-00b345c6dba5-tls-cert\") pod \"dbc43350-b512-4e3a-b180-00b345c6dba5\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " Jul 10 14:56:27.404617 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.404502 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzsns\" (UniqueName: \"kubernetes.io/projected/dbc43350-b512-4e3a-b180-00b345c6dba5-kube-api-access-dzsns\") pod \"dbc43350-b512-4e3a-b180-00b345c6dba5\" (UID: \"dbc43350-b512-4e3a-b180-00b345c6dba5\") " Jul 10 14:56:27.407075 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.407040 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc43350-b512-4e3a-b180-00b345c6dba5-kube-api-access-dzsns" (OuterVolumeSpecName: "kube-api-access-dzsns") pod "dbc43350-b512-4e3a-b180-00b345c6dba5" (UID: "dbc43350-b512-4e3a-b180-00b345c6dba5"). InnerVolumeSpecName "kube-api-access-dzsns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:56:27.416294 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.416267 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbc43350-b512-4e3a-b180-00b345c6dba5-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dbc43350-b512-4e3a-b180-00b345c6dba5" (UID: "dbc43350-b512-4e3a-b180-00b345c6dba5"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:56:27.506125 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.506085 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzsns\" (UniqueName: \"kubernetes.io/projected/dbc43350-b512-4e3a-b180-00b345c6dba5-kube-api-access-dzsns\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:56:27.506125 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.506125 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbc43350-b512-4e3a-b180-00b345c6dba5-tls-cert\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 14:56:27.823690 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.823651 2572 generic.go:356] "Generic (PLEG): container finished" podID="dbc43350-b512-4e3a-b180-00b345c6dba5" containerID="c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b" exitCode=0 Jul 10 14:56:27.823690 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.823697 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" Jul 10 14:56:27.824206 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.823728 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" event={"ID":"dbc43350-b512-4e3a-b180-00b345c6dba5","Type":"ContainerDied","Data":"c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b"} Jul 10 14:56:27.824206 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.823774 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9599b5c6-rtn54" event={"ID":"dbc43350-b512-4e3a-b180-00b345c6dba5","Type":"ContainerDied","Data":"67ff38c15cbd59737a81a3a6205f08941d727678ff66501c1abfd60ac20efafc"} Jul 10 14:56:27.824206 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.823796 2572 scope.go:117] "RemoveContainer" containerID="c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b" Jul 10 14:56:27.834645 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.834624 2572 scope.go:117] "RemoveContainer" containerID="c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b" Jul 10 14:56:27.834962 ip-10-0-133-29 kubenswrapper[2572]: E0710 14:56:27.834936 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b\": container with ID starting with c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b not found: ID does not exist" containerID="c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b" Jul 10 14:56:27.835052 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.834970 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b"} err="failed to get container status \"c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b\": rpc error: code = NotFound desc = could not find container \"c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b\": container with ID starting with c4def764d606ee0d9909dbe307d2e432ed43e97c52deba8f12e88cbe3a43575b not found: ID does not exist" Jul 10 14:56:27.874112 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.874085 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c9599b5c6-rtn54"] Jul 10 14:56:27.885062 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:27.885038 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c9599b5c6-rtn54"] Jul 10 14:56:29.807286 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:56:29.807253 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc43350-b512-4e3a-b180-00b345c6dba5" path="/var/lib/kubelet/pods/dbc43350-b512-4e3a-b180-00b345c6dba5/volumes" Jul 10 14:57:54.225012 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:57:54.224979 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:57:54.326578 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:57:54.326537 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:57:58.162759 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:57:58.162713 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:00.113329 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:00.113296 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:10.133382 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:10.133333 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:40.981803 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:40.981763 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:41.075290 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:41.075256 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:41.205564 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:41.205526 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:47.441224 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:47.441189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:47.515596 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:47.515566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:47.601754 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:47.601720 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:47.703563 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:47.703490 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:47.806774 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:47.806751 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:53.630605 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:53.630572 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:58:53.730324 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:58:53.730290 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 14:59:57.614190 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:59:57.614105 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:59:57.616781 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:59:57.614839 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 14:59:57.619176 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:59:57.619157 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 14:59:57.619617 ip-10-0-133-29 kubenswrapper[2572]: I0710 14:59:57.619595 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:00:00.162438 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.162405 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr"] Jul 10 15:00:00.162854 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.162730 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc43350-b512-4e3a-b180-00b345c6dba5" containerName="authorino" Jul 10 15:00:00.162854 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.162741 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc43350-b512-4e3a-b180-00b345c6dba5" containerName="authorino" Jul 10 15:00:00.162854 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.162809 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc43350-b512-4e3a-b180-00b345c6dba5" containerName="authorino" Jul 10 15:00:00.165864 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.165839 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" Jul 10 15:00:00.168776 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.168757 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 15:00:00.168776 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.168771 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 15:00:00.168964 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.168849 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-whm6h\"" Jul 10 15:00:00.180876 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.180848 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr"] Jul 10 15:00:00.194301 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.194276 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5h5t\" (UniqueName: \"kubernetes.io/projected/647ff0e2-e49b-4a8f-8ba6-1f2b63520b72-kube-api-access-g5h5t\") pod \"maas-api-key-cleanup-29728260-mqmhr\" (UID: \"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" Jul 10 15:00:00.294639 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.294611 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5h5t\" (UniqueName: \"kubernetes.io/projected/647ff0e2-e49b-4a8f-8ba6-1f2b63520b72-kube-api-access-g5h5t\") pod \"maas-api-key-cleanup-29728260-mqmhr\" (UID: \"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" Jul 10 15:00:00.304523 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.304497 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5h5t\" (UniqueName: \"kubernetes.io/projected/647ff0e2-e49b-4a8f-8ba6-1f2b63520b72-kube-api-access-g5h5t\") pod \"maas-api-key-cleanup-29728260-mqmhr\" (UID: \"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" Jul 10 15:00:00.475937 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.475879 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" Jul 10 15:00:00.612396 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.612364 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr"] Jul 10 15:00:00.614616 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:00:00.614582 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647ff0e2_e49b_4a8f_8ba6_1f2b63520b72.slice/crio-e8cdbaba8fc81b4b54701e78f68e60b3cdb26f40df5b5d32b73acd99a81d7cb6 WatchSource:0}: Error finding container e8cdbaba8fc81b4b54701e78f68e60b3cdb26f40df5b5d32b73acd99a81d7cb6: Status 404 returned error can't find the container with id e8cdbaba8fc81b4b54701e78f68e60b3cdb26f40df5b5d32b73acd99a81d7cb6 Jul 10 15:00:00.816878 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:00.816779 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" event={"ID":"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72","Type":"ContainerStarted","Data":"e8cdbaba8fc81b4b54701e78f68e60b3cdb26f40df5b5d32b73acd99a81d7cb6"} Jul 10 15:00:13.878152 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:13.878099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" event={"ID":"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72","Type":"ContainerStarted","Data":"065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd"} Jul 10 15:00:13.893238 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:13.893189 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" podStartSLOduration=1.5281238400000001 podStartE2EDuration="13.893172695s" totalImagesPullingTime="12.365048855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:00:13.892581643 +0000 UTC m=+916.759011941" watchObservedRunningTime="2026-07-10 15:00:13.893172695 +0000 UTC m=+916.759602989" Jul 10 15:00:54.423978 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:54.423944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:00:56.026945 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:00:56.026912 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:01:00.011771 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:00.011737 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr"] Jul 10 15:01:00.012245 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:00.011953 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" podUID="647ff0e2-e49b-4a8f-8ba6-1f2b63520b72" containerName="cleanup" containerID="cri-o://065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd" gracePeriod=30 Jul 10 15:01:06.975632 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:06.975583 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:01:30.176556 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.176532 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" Jul 10 15:01:30.227584 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.227551 2572 generic.go:356] "Generic (PLEG): container finished" podID="647ff0e2-e49b-4a8f-8ba6-1f2b63520b72" containerID="065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd" exitCode=137 Jul 10 15:01:30.227698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.227590 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" Jul 10 15:01:30.227698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.227618 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" event={"ID":"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72","Type":"ContainerDied","Data":"065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd"} Jul 10 15:01:30.227698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.227661 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr" event={"ID":"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72","Type":"ContainerDied","Data":"e8cdbaba8fc81b4b54701e78f68e60b3cdb26f40df5b5d32b73acd99a81d7cb6"} Jul 10 15:01:30.227698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.227683 2572 scope.go:117] "RemoveContainer" containerID="065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd" Jul 10 15:01:30.235522 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.235506 2572 scope.go:117] "RemoveContainer" containerID="065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd" Jul 10 15:01:30.235795 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:01:30.235771 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd\": container with ID starting with 065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd not found: ID does not exist" containerID="065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd" Jul 10 15:01:30.235909 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.235805 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd"} err="failed to get container status \"065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd\": rpc error: code = NotFound desc = could not find container \"065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd\": container with ID starting with 065f8d0400c633207408d18200737e751b562d7c2398d7dce4d49acb63bde7bd not found: ID does not exist" Jul 10 15:01:30.312622 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.312565 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5h5t\" (UniqueName: \"kubernetes.io/projected/647ff0e2-e49b-4a8f-8ba6-1f2b63520b72-kube-api-access-g5h5t\") pod \"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72\" (UID: \"647ff0e2-e49b-4a8f-8ba6-1f2b63520b72\") " Jul 10 15:01:30.314624 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.314603 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647ff0e2-e49b-4a8f-8ba6-1f2b63520b72-kube-api-access-g5h5t" (OuterVolumeSpecName: "kube-api-access-g5h5t") pod "647ff0e2-e49b-4a8f-8ba6-1f2b63520b72" (UID: "647ff0e2-e49b-4a8f-8ba6-1f2b63520b72"). InnerVolumeSpecName "kube-api-access-g5h5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:01:30.413473 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.413451 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5h5t\" (UniqueName: \"kubernetes.io/projected/647ff0e2-e49b-4a8f-8ba6-1f2b63520b72-kube-api-access-g5h5t\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:01:30.549874 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.549848 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr"] Jul 10 15:01:30.555680 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:30.555657 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-mqmhr"] Jul 10 15:01:30.570977 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:01:30.570922 2572 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647ff0e2_e49b_4a8f_8ba6_1f2b63520b72.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod647ff0e2_e49b_4a8f_8ba6_1f2b63520b72.slice/crio-e8cdbaba8fc81b4b54701e78f68e60b3cdb26f40df5b5d32b73acd99a81d7cb6\": RecentStats: unable to find data in memory cache]" Jul 10 15:01:31.807176 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:01:31.807146 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="647ff0e2-e49b-4a8f-8ba6-1f2b63520b72" path="/var/lib/kubelet/pods/647ff0e2-e49b-4a8f-8ba6-1f2b63520b72/volumes" Jul 10 15:02:16.961622 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:16.961584 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:02:17.060391 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:17.060355 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:02:49.916704 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:49.916675 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq"] Jul 10 15:02:49.917297 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:49.916854 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" podUID="0e45105a-8a60-431d-a2aa-d1963cb83d37" containerName="manager" containerID="cri-o://f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e" gracePeriod=10 Jul 10 15:02:53.576723 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.576701 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 15:02:53.592368 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.592324 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45105a-8a60-431d-a2aa-d1963cb83d37-extensions-socket-volume\") pod \"0e45105a-8a60-431d-a2aa-d1963cb83d37\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " Jul 10 15:02:53.592464 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.592379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l75nq\" (UniqueName: \"kubernetes.io/projected/0e45105a-8a60-431d-a2aa-d1963cb83d37-kube-api-access-l75nq\") pod \"0e45105a-8a60-431d-a2aa-d1963cb83d37\" (UID: \"0e45105a-8a60-431d-a2aa-d1963cb83d37\") " Jul 10 15:02:53.592703 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.592678 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e45105a-8a60-431d-a2aa-d1963cb83d37-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0e45105a-8a60-431d-a2aa-d1963cb83d37" (UID: "0e45105a-8a60-431d-a2aa-d1963cb83d37"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:02:53.594317 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.594298 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e45105a-8a60-431d-a2aa-d1963cb83d37-kube-api-access-l75nq" (OuterVolumeSpecName: "kube-api-access-l75nq") pod "0e45105a-8a60-431d-a2aa-d1963cb83d37" (UID: "0e45105a-8a60-431d-a2aa-d1963cb83d37"). InnerVolumeSpecName "kube-api-access-l75nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:02:53.620044 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.620017 2572 generic.go:356] "Generic (PLEG): container finished" podID="0e45105a-8a60-431d-a2aa-d1963cb83d37" containerID="f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e" exitCode=0 Jul 10 15:02:53.620152 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.620056 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" Jul 10 15:02:53.620152 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.620094 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" event={"ID":"0e45105a-8a60-431d-a2aa-d1963cb83d37","Type":"ContainerDied","Data":"f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e"} Jul 10 15:02:53.620152 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.620143 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq" event={"ID":"0e45105a-8a60-431d-a2aa-d1963cb83d37","Type":"ContainerDied","Data":"af78be1640e4d999bdc42955f60400c3f58bba9a603cab2644f11288fb263b2b"} Jul 10 15:02:53.620297 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.620164 2572 scope.go:117] "RemoveContainer" containerID="f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e" Jul 10 15:02:53.631784 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.631763 2572 scope.go:117] "RemoveContainer" containerID="f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e" Jul 10 15:02:53.632066 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:02:53.632046 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e\": container with ID starting with f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e not found: ID does not exist" containerID="f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e" Jul 10 15:02:53.632154 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.632072 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e"} err="failed to get container status \"f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e\": rpc error: code = NotFound desc = could not find container \"f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e\": container with ID starting with f489691015e84c46257881f42c747bfa802df8ea4e6baf852ceb9b6bb14dc70e not found: ID does not exist" Jul 10 15:02:53.664082 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.664057 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq"] Jul 10 15:02:53.667651 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.667628 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2zzcq"] Jul 10 15:02:53.693715 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.693694 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l75nq\" (UniqueName: \"kubernetes.io/projected/0e45105a-8a60-431d-a2aa-d1963cb83d37-kube-api-access-l75nq\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:02:53.693715 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.693715 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45105a-8a60-431d-a2aa-d1963cb83d37-extensions-socket-volume\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:02:53.806801 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:02:53.806776 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e45105a-8a60-431d-a2aa-d1963cb83d37" path="/var/lib/kubelet/pods/0e45105a-8a60-431d-a2aa-d1963cb83d37/volumes" Jul 10 15:03:51.090559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.087972 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb"] Jul 10 15:03:51.090559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.088745 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e45105a-8a60-431d-a2aa-d1963cb83d37" containerName="manager" Jul 10 15:03:51.090559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.088765 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e45105a-8a60-431d-a2aa-d1963cb83d37" containerName="manager" Jul 10 15:03:51.090559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.088778 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647ff0e2-e49b-4a8f-8ba6-1f2b63520b72" containerName="cleanup" Jul 10 15:03:51.090559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.088786 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="647ff0e2-e49b-4a8f-8ba6-1f2b63520b72" containerName="cleanup" Jul 10 15:03:51.090559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.088991 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e45105a-8a60-431d-a2aa-d1963cb83d37" containerName="manager" Jul 10 15:03:51.090559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.089005 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="647ff0e2-e49b-4a8f-8ba6-1f2b63520b72" containerName="cleanup" Jul 10 15:03:51.092644 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.092621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.096549 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.096526 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fffgr\"" Jul 10 15:03:51.107786 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.107760 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb"] Jul 10 15:03:51.245088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.245051 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1483756-8e0a-4e27-a39b-60b50662f8c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j4csb\" (UID: \"c1483756-8e0a-4e27-a39b-60b50662f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.245261 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.245171 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-448v6\" (UniqueName: \"kubernetes.io/projected/c1483756-8e0a-4e27-a39b-60b50662f8c3-kube-api-access-448v6\") pod \"kuadrant-operator-controller-manager-86878c769f-j4csb\" (UID: \"c1483756-8e0a-4e27-a39b-60b50662f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.346031 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.345942 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-448v6\" (UniqueName: \"kubernetes.io/projected/c1483756-8e0a-4e27-a39b-60b50662f8c3-kube-api-access-448v6\") pod \"kuadrant-operator-controller-manager-86878c769f-j4csb\" (UID: \"c1483756-8e0a-4e27-a39b-60b50662f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.346031 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.346008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1483756-8e0a-4e27-a39b-60b50662f8c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j4csb\" (UID: \"c1483756-8e0a-4e27-a39b-60b50662f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.346330 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.346308 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c1483756-8e0a-4e27-a39b-60b50662f8c3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-j4csb\" (UID: \"c1483756-8e0a-4e27-a39b-60b50662f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.354781 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.354750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-448v6\" (UniqueName: \"kubernetes.io/projected/c1483756-8e0a-4e27-a39b-60b50662f8c3-kube-api-access-448v6\") pod \"kuadrant-operator-controller-manager-86878c769f-j4csb\" (UID: \"c1483756-8e0a-4e27-a39b-60b50662f8c3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.403546 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.403522 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.548204 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.548178 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb"] Jul 10 15:03:51.550453 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:03:51.550423 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1483756_8e0a_4e27_a39b_60b50662f8c3.slice/crio-9b5cd881814a4dcad1057d360381f618eb5d7eecaa2a9ca54fd1071d7f86749d WatchSource:0}: Error finding container 9b5cd881814a4dcad1057d360381f618eb5d7eecaa2a9ca54fd1071d7f86749d: Status 404 returned error can't find the container with id 9b5cd881814a4dcad1057d360381f618eb5d7eecaa2a9ca54fd1071d7f86749d Jul 10 15:03:51.885654 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.885553 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" event={"ID":"c1483756-8e0a-4e27-a39b-60b50662f8c3","Type":"ContainerStarted","Data":"5e0cdc89713b981db8a97f0496491f006d2eb0def1326a3ed1ac54404f14c4f6"} Jul 10 15:03:51.885654 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.885613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" event={"ID":"c1483756-8e0a-4e27-a39b-60b50662f8c3","Type":"ContainerStarted","Data":"9b5cd881814a4dcad1057d360381f618eb5d7eecaa2a9ca54fd1071d7f86749d"} Jul 10 15:03:51.885654 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.885634 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:03:51.908131 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:03:51.908081 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" podStartSLOduration=0.908066309 podStartE2EDuration="908.066309ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:03:51.906538867 +0000 UTC m=+1134.772969160" watchObservedRunningTime="2026-07-10 15:03:51.908066309 +0000 UTC m=+1134.774496673" Jul 10 15:04:02.892935 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:04:02.892895 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-j4csb" Jul 10 15:04:57.642894 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:04:57.642866 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:04:57.645199 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:04:57.644882 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:04:57.647110 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:04:57.647095 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:04:57.648739 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:04:57.648720 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:05:29.577926 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:05:29.577888 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:05:29.665390 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:05:29.665358 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:05:36.514137 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:05:36.514100 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:06:17.182474 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:06:17.182363 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:33.298359 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:33.298281 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:33.397470 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:33.397433 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:33.497751 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:33.497722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:34.051158 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:34.051122 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:34.152492 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:34.152463 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:43.954613 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:43.954580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:44.010552 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:44.010522 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:07:44.068843 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:07:44.068789 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:08:59.116532 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:08:59.116445 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:09:57.669456 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:09:57.669354 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:09:57.673454 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:09:57.671972 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:09:57.673454 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:09:57.673185 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:09:57.675952 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:09:57.675932 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:13:06.194160 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:13:06.194117 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:14:57.695567 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:14:57.695450 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:14:57.706351 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:14:57.701269 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:14:57.706351 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:14:57.705755 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:14:57.708896 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:14:57.708867 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:15:00.149209 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.149178 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f"] Jul 10 15:15:00.152247 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.152231 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" Jul 10 15:15:00.155370 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.155351 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-whm6h\"" Jul 10 15:15:00.156270 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.156255 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 10 15:15:00.156323 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.156257 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 10 15:15:00.171827 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.171803 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f"] Jul 10 15:15:00.199129 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.199103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8dth\" (UniqueName: \"kubernetes.io/projected/c3765fc5-b634-4ed5-a9a6-3497b2f25940-kube-api-access-q8dth\") pod \"maas-api-key-cleanup-29728275-crq8f\" (UID: \"c3765fc5-b634-4ed5-a9a6-3497b2f25940\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" Jul 10 15:15:00.300174 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.300151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8dth\" (UniqueName: \"kubernetes.io/projected/c3765fc5-b634-4ed5-a9a6-3497b2f25940-kube-api-access-q8dth\") pod \"maas-api-key-cleanup-29728275-crq8f\" (UID: \"c3765fc5-b634-4ed5-a9a6-3497b2f25940\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" Jul 10 15:15:00.310830 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.310802 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8dth\" (UniqueName: \"kubernetes.io/projected/c3765fc5-b634-4ed5-a9a6-3497b2f25940-kube-api-access-q8dth\") pod \"maas-api-key-cleanup-29728275-crq8f\" (UID: \"c3765fc5-b634-4ed5-a9a6-3497b2f25940\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" Jul 10 15:15:00.461589 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.461532 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" Jul 10 15:15:00.602320 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.602294 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f"] Jul 10 15:15:00.603712 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:15:00.603672 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3765fc5_b634_4ed5_a9a6_3497b2f25940.slice/crio-7ea794614fadf0c13d1bcbd32f18e7f2b31f362a68116d306fdfa5407919a1db WatchSource:0}: Error finding container 7ea794614fadf0c13d1bcbd32f18e7f2b31f362a68116d306fdfa5407919a1db: Status 404 returned error can't find the container with id 7ea794614fadf0c13d1bcbd32f18e7f2b31f362a68116d306fdfa5407919a1db Jul 10 15:15:00.868157 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.868127 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" event={"ID":"c3765fc5-b634-4ed5-a9a6-3497b2f25940","Type":"ContainerStarted","Data":"b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97"} Jul 10 15:15:00.868247 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.868172 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" event={"ID":"c3765fc5-b634-4ed5-a9a6-3497b2f25940","Type":"ContainerStarted","Data":"7ea794614fadf0c13d1bcbd32f18e7f2b31f362a68116d306fdfa5407919a1db"} Jul 10 15:15:00.886717 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:00.886672 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" podStartSLOduration=0.88665765 podStartE2EDuration="886.65765ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:15:00.884449228 +0000 UTC m=+1803.750879521" watchObservedRunningTime="2026-07-10 15:15:00.88665765 +0000 UTC m=+1803.753087944" Jul 10 15:15:54.015586 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:54.015554 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:15:54.140039 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:54.140004 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:15:55.106407 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:15:55.106368 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:00.010878 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:00.010846 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f"] Jul 10 15:16:00.011324 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:00.011030 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" podUID="c3765fc5-b634-4ed5-a9a6-3497b2f25940" containerName="cleanup" containerID="cri-o://b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97" gracePeriod=30 Jul 10 15:16:01.234331 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.234294 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:01.330138 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.330111 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:01.411551 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.411520 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99"] Jul 10 15:16:01.414886 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.414864 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.417377 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.417354 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0dbbab33-openshift-default-dockercfg-sr6j4\"" Jul 10 15:16:01.425516 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.425493 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99"] Jul 10 15:16:01.441196 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.441169 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:01.464264 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464239 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-podinfo\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464357 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464264 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istiod-ca-cert\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464357 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54xb2\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-kube-api-access-54xb2\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464435 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-socket\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464435 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-token\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464435 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464394 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-envoy\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464435 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-certs\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464557 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464445 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-credential-socket\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.464557 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.464511 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-data\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565486 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565414 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-certs\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565486 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-credential-socket\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565486 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-data\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565731 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-podinfo\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565731 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565535 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istiod-ca-cert\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565731 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565581 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54xb2\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-kube-api-access-54xb2\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565731 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-socket\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565731 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-token\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.565731 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-envoy\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.566080 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565873 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-certs\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.566080 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.565927 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-credential-socket\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.566080 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.566005 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-data\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.566080 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.566060 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-socket\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.566262 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.566242 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istiod-ca-cert\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.567905 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.567873 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-envoy\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.568168 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.568149 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-podinfo\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.578643 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.578610 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:01.581876 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.581858 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-token\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.584260 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.584235 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54xb2\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-kube-api-access-54xb2\") pod \"e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.726010 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.725975 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:01.866309 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.866285 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99"] Jul 10 15:16:01.867703 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:16:01.867680 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f756f6_c954_4dcb_833a_ec083bf1fa9d.slice/crio-6ff454382062542d3d668aaddbbc4d8f46c34fcdae7c0681e764c9a32a2d0651 WatchSource:0}: Error finding container 6ff454382062542d3d668aaddbbc4d8f46c34fcdae7c0681e764c9a32a2d0651: Status 404 returned error can't find the container with id 6ff454382062542d3d668aaddbbc4d8f46c34fcdae7c0681e764c9a32a2d0651 Jul 10 15:16:01.869869 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.869807 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:01.869938 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.869901 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:01.869975 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:01.869946 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:02.141738 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:02.141706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" event={"ID":"01f756f6-c954-4dcb-833a-ec083bf1fa9d","Type":"ContainerStarted","Data":"15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95"} Jul 10 15:16:02.141900 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:02.141761 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" event={"ID":"01f756f6-c954-4dcb-833a-ec083bf1fa9d","Type":"ContainerStarted","Data":"6ff454382062542d3d668aaddbbc4d8f46c34fcdae7c0681e764c9a32a2d0651"} Jul 10 15:16:02.168220 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:02.168176 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" podStartSLOduration=1.168161585 podStartE2EDuration="1.168161585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:16:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:16:02.166278248 +0000 UTC m=+1865.032708541" watchObservedRunningTime="2026-07-10 15:16:02.168161585 +0000 UTC m=+1865.034591878" Jul 10 15:16:02.653211 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:02.653183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:02.726677 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:02.726647 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:02.731138 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:02.731117 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:02.790891 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:02.790851 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:03.146499 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:03.146469 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:03.147422 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:03.147405 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:05.220598 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:05.220566 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:07.728308 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:07.728272 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:07.914177 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:07.914146 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99"] Jul 10 15:16:07.914336 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:07.914305 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" podUID="01f756f6-c954-4dcb-833a-ec083bf1fa9d" containerName="istio-proxy" containerID="cri-o://15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95" gracePeriod=30 Jul 10 15:16:07.940167 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:07.940132 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:08.040324 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:08.040248 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:09.456198 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:09.456166 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:13.163989 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.163964 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:13.197864 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.197784 2572 generic.go:356] "Generic (PLEG): container finished" podID="01f756f6-c954-4dcb-833a-ec083bf1fa9d" containerID="15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95" exitCode=0 Jul 10 15:16:13.197864 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.197832 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" Jul 10 15:16:13.198046 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.197870 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" event={"ID":"01f756f6-c954-4dcb-833a-ec083bf1fa9d","Type":"ContainerDied","Data":"15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95"} Jul 10 15:16:13.198046 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.197918 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99" event={"ID":"01f756f6-c954-4dcb-833a-ec083bf1fa9d","Type":"ContainerDied","Data":"6ff454382062542d3d668aaddbbc4d8f46c34fcdae7c0681e764c9a32a2d0651"} Jul 10 15:16:13.198046 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.197942 2572 scope.go:117] "RemoveContainer" containerID="15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95" Jul 10 15:16:13.206325 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.206305 2572 scope.go:117] "RemoveContainer" containerID="15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95" Jul 10 15:16:13.206625 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:16:13.206605 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95\": container with ID starting with 15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95 not found: ID does not exist" containerID="15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95" Jul 10 15:16:13.206726 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.206630 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95"} err="failed to get container status \"15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95\": rpc error: code = NotFound desc = could not find container \"15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95\": container with ID starting with 15389a3c9766410160023ba74c40d62d50d19c2d4a0acfe6fac7c7111cbc7d95 not found: ID does not exist" Jul 10 15:16:13.258739 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258722 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-socket\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.258864 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258752 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istiod-ca-cert\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.258864 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258771 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-certs\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.258864 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258796 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-credential-socket\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.258864 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258845 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54xb2\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-kube-api-access-54xb2\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.259088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258874 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-token\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.259088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258893 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-data\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.259088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258939 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-podinfo\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.259088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.258962 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-envoy\") pod \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\" (UID: \"01f756f6-c954-4dcb-833a-ec083bf1fa9d\") " Jul 10 15:16:13.259088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259021 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:13.259088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259082 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:13.259392 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259123 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:16:13.259392 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259267 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.259392 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259286 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istiod-ca-cert\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.259521 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259389 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:13.259521 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259404 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-workload-certs\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.259521 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.259414 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-data" (OuterVolumeSpecName: "istio-data") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:13.261198 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.261176 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:13.261284 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.261201 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-token" (OuterVolumeSpecName: "istio-token") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:16:13.261399 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.261377 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-kube-api-access-54xb2" (OuterVolumeSpecName: "kube-api-access-54xb2") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "kube-api-access-54xb2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:16:13.261501 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.261442 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "01f756f6-c954-4dcb-833a-ec083bf1fa9d" (UID: "01f756f6-c954-4dcb-833a-ec083bf1fa9d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 15:16:13.359990 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.359963 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-credential-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.359990 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.359987 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54xb2\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-kube-api-access-54xb2\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.360149 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.359997 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-token\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.360149 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.360006 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-data\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.360149 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.360014 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-podinfo\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.360149 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.360021 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/01f756f6-c954-4dcb-833a-ec083bf1fa9d-istio-envoy\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:13.520806 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.520779 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99"] Jul 10 15:16:13.524928 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.524902 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0dbbab33-openshift-default-54d6bdb7d5-pfn99"] Jul 10 15:16:13.806943 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:13.806879 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f756f6-c954-4dcb-833a-ec083bf1fa9d" path="/var/lib/kubelet/pods/01f756f6-c954-4dcb-833a-ec083bf1fa9d/volumes" Jul 10 15:16:14.031901 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.031865 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:14.143982 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.143949 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:14.234039 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.234010 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj"] Jul 10 15:16:14.234404 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.234390 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f756f6-c954-4dcb-833a-ec083bf1fa9d" containerName="istio-proxy" Jul 10 15:16:14.234446 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.234408 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f756f6-c954-4dcb-833a-ec083bf1fa9d" containerName="istio-proxy" Jul 10 15:16:14.234487 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.234475 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f756f6-c954-4dcb-833a-ec083bf1fa9d" containerName="istio-proxy" Jul 10 15:16:14.238814 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.238794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.243240 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:16:14.243208 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" is forbidden: User \"system:node:ip-10-0-133-29.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-29.ec2.internal' and this object" podUID="583e5830-3c4f-4b18-ac28-a9b3c583b737" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.243353 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:16:14.243317 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-ait-4ef8e887-openshift-default-dockercfg-7znmg\" is forbidden: User \"system:node:ip-10-0-133-29.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-29.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-ait-4ef8e887-openshift-default-dockercfg-7znmg\"" type="*v1.Secret" Jul 10 15:16:14.263736 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.263711 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj"] Jul 10 15:16:14.269235 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269211 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp996\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-kube-api-access-wp996\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269349 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-certs\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269349 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-podinfo\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269349 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269315 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-data\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269349 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-credential-socket\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269569 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/583e5830-3c4f-4b18-ac28-a9b3c583b737-istiod-ca-cert\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269569 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-envoy\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269569 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-token\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.269569 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.269521 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-socket\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.370648 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-credential-socket\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.370816 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370668 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/583e5830-3c4f-4b18-ac28-a9b3c583b737-istiod-ca-cert\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.370816 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370708 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-envoy\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.370816 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370751 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-token\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.370816 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-socket\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371069 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp996\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-kube-api-access-wp996\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371069 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-certs\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371069 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-podinfo\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371069 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.370982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-data\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371258 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.371077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-credential-socket\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371426 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.371403 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-certs\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371505 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.371429 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-socket\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371505 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.371458 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/583e5830-3c4f-4b18-ac28-a9b3c583b737-istiod-ca-cert\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.371568 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.371550 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-data\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.373055 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.373026 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-envoy\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.373321 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.373302 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-podinfo\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.384431 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.384405 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:14.385638 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.385617 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp996\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-kube-api-access-wp996\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.388348 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.388329 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-token\") pod \"e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:14.499562 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:14.499476 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:15.152315 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.152285 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4ef8e887-openshift-default-dockercfg-7znmg\"" Jul 10 15:16:15.162359 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.162339 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:15.297335 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.297309 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj"] Jul 10 15:16:15.299271 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:16:15.299244 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod583e5830_3c4f_4b18_ac28_a9b3c583b737.slice/crio-8a8034f26ce46cb766ccb00e0281913604fbdde3fb7281b18c7656e1227f1ffc WatchSource:0}: Error finding container 8a8034f26ce46cb766ccb00e0281913604fbdde3fb7281b18c7656e1227f1ffc: Status 404 returned error can't find the container with id 8a8034f26ce46cb766ccb00e0281913604fbdde3fb7281b18c7656e1227f1ffc Jul 10 15:16:15.301470 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.301437 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:15.301566 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.301517 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:15.301630 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.301561 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:15.492722 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.492602 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:15.682112 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:15.682080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:16.013050 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:16.013021 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:16.215732 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:16.215697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" event={"ID":"583e5830-3c4f-4b18-ac28-a9b3c583b737","Type":"ContainerStarted","Data":"c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a"} Jul 10 15:16:16.215892 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:16.215753 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" event={"ID":"583e5830-3c4f-4b18-ac28-a9b3c583b737","Type":"ContainerStarted","Data":"8a8034f26ce46cb766ccb00e0281913604fbdde3fb7281b18c7656e1227f1ffc"} Jul 10 15:16:16.238491 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:16.238447 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" podStartSLOduration=2.238433529 podStartE2EDuration="2.238433529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:16:16.236839954 +0000 UTC m=+1879.103270249" watchObservedRunningTime="2026-07-10 15:16:16.238433529 +0000 UTC m=+1879.104863860" Jul 10 15:16:16.269068 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:16.268997 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:16.545035 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:16.544951 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:16.648648 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:16.648615 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:17.162900 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:17.162868 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:17.167977 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:17.167951 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:17.220568 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:17.220548 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:17.221334 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:17.221317 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:18.188620 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:18.188563 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:20.676041 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:20.675959 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:21.146179 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:21.146143 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:26.694391 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:26.694355 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj"] Jul 10 15:16:26.694845 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:26.694584 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" podUID="583e5830-3c4f-4b18-ac28-a9b3c583b737" containerName="istio-proxy" containerID="cri-o://c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a" gracePeriod=30 Jul 10 15:16:26.730026 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:26.729987 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:26.844007 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:26.843961 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:28.362636 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:28.362597 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:30.193747 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.193725 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" Jul 10 15:16:30.281264 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.281192 2572 generic.go:356] "Generic (PLEG): container finished" podID="c3765fc5-b634-4ed5-a9a6-3497b2f25940" containerID="b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97" exitCode=137 Jul 10 15:16:30.281264 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.281228 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" Jul 10 15:16:30.281422 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.281267 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" event={"ID":"c3765fc5-b634-4ed5-a9a6-3497b2f25940","Type":"ContainerDied","Data":"b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97"} Jul 10 15:16:30.281422 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.281320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f" event={"ID":"c3765fc5-b634-4ed5-a9a6-3497b2f25940","Type":"ContainerDied","Data":"7ea794614fadf0c13d1bcbd32f18e7f2b31f362a68116d306fdfa5407919a1db"} Jul 10 15:16:30.281422 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.281342 2572 scope.go:117] "RemoveContainer" containerID="b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97" Jul 10 15:16:30.289344 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.289328 2572 scope.go:117] "RemoveContainer" containerID="b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97" Jul 10 15:16:30.289595 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:16:30.289563 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97\": container with ID starting with b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97 not found: ID does not exist" containerID="b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97" Jul 10 15:16:30.289641 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.289606 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97"} err="failed to get container status \"b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97\": rpc error: code = NotFound desc = could not find container \"b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97\": container with ID starting with b138d214e61a2ba876860256b9288ae065579295a0697f9dc39a1fd2255ecb97 not found: ID does not exist" Jul 10 15:16:30.298936 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.298913 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8dth\" (UniqueName: \"kubernetes.io/projected/c3765fc5-b634-4ed5-a9a6-3497b2f25940-kube-api-access-q8dth\") pod \"c3765fc5-b634-4ed5-a9a6-3497b2f25940\" (UID: \"c3765fc5-b634-4ed5-a9a6-3497b2f25940\") " Jul 10 15:16:30.300736 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.300717 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3765fc5-b634-4ed5-a9a6-3497b2f25940-kube-api-access-q8dth" (OuterVolumeSpecName: "kube-api-access-q8dth") pod "c3765fc5-b634-4ed5-a9a6-3497b2f25940" (UID: "c3765fc5-b634-4ed5-a9a6-3497b2f25940"). InnerVolumeSpecName "kube-api-access-q8dth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:16:30.400421 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.400396 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8dth\" (UniqueName: \"kubernetes.io/projected/c3765fc5-b634-4ed5-a9a6-3497b2f25940-kube-api-access-q8dth\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:30.604191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.604168 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f"] Jul 10 15:16:30.606559 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:30.606538 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728275-crq8f"] Jul 10 15:16:31.806895 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:31.806865 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3765fc5-b634-4ed5-a9a6-3497b2f25940" path="/var/lib/kubelet/pods/c3765fc5-b634-4ed5-a9a6-3497b2f25940/volumes" Jul 10 15:16:31.953133 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:31.953073 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:32.013737 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013709 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-data\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.013872 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013766 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-envoy\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.013872 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013803 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-certs\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.013872 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013843 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-credential-socket\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.014006 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013873 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wp996\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-kube-api-access-wp996\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.014006 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013897 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/583e5830-3c4f-4b18-ac28-a9b3c583b737-istiod-ca-cert\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.014006 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013924 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-podinfo\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.014006 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.013970 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-token\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.014006 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014004 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-socket\") pod \"583e5830-3c4f-4b18-ac28-a9b3c583b737\" (UID: \"583e5830-3c4f-4b18-ac28-a9b3c583b737\") " Jul 10 15:16:32.014254 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014033 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-data" (OuterVolumeSpecName: "istio-data") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:32.014254 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014158 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:32.014254 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014170 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:32.014409 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014357 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-data\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.014409 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014362 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:32.014409 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014365 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/583e5830-3c4f-4b18-ac28-a9b3c583b737-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:16:32.014409 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014376 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-certs\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.014565 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.014414 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-credential-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.015922 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.015901 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:32.016097 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.016083 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-token" (OuterVolumeSpecName: "istio-token") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:16:32.016396 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.016373 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 15:16:32.016483 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.016390 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-kube-api-access-wp996" (OuterVolumeSpecName: "kube-api-access-wp996") pod "583e5830-3c4f-4b18-ac28-a9b3c583b737" (UID: "583e5830-3c4f-4b18-ac28-a9b3c583b737"). InnerVolumeSpecName "kube-api-access-wp996". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:16:32.115322 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.115297 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-envoy\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.115322 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.115322 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp996\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-kube-api-access-wp996\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.115466 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.115333 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/583e5830-3c4f-4b18-ac28-a9b3c583b737-istiod-ca-cert\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.115466 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.115342 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-podinfo\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.115466 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.115350 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/583e5830-3c4f-4b18-ac28-a9b3c583b737-istio-token\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.115466 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.115357 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/583e5830-3c4f-4b18-ac28-a9b3c583b737-workload-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:32.293899 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.293811 2572 generic.go:356] "Generic (PLEG): container finished" podID="583e5830-3c4f-4b18-ac28-a9b3c583b737" containerID="c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a" exitCode=0 Jul 10 15:16:32.293899 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.293845 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" event={"ID":"583e5830-3c4f-4b18-ac28-a9b3c583b737","Type":"ContainerDied","Data":"c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a"} Jul 10 15:16:32.293899 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.293879 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" Jul 10 15:16:32.293899 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.293897 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj" event={"ID":"583e5830-3c4f-4b18-ac28-a9b3c583b737","Type":"ContainerDied","Data":"8a8034f26ce46cb766ccb00e0281913604fbdde3fb7281b18c7656e1227f1ffc"} Jul 10 15:16:32.294275 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.293920 2572 scope.go:117] "RemoveContainer" containerID="c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a" Jul 10 15:16:32.302696 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.302679 2572 scope.go:117] "RemoveContainer" containerID="c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a" Jul 10 15:16:32.303068 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:16:32.303046 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a\": container with ID starting with c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a not found: ID does not exist" containerID="c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a" Jul 10 15:16:32.303180 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.303074 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a"} err="failed to get container status \"c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a\": rpc error: code = NotFound desc = could not find container \"c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a\": container with ID starting with c0212c6841e4babba6b8b724b091d78682e5cd822e320a38c0fef8f3992b868a not found: ID does not exist" Jul 10 15:16:32.316507 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.316488 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj"] Jul 10 15:16:32.325371 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:32.325346 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4ef8e887-openshift-default-7768b6664f-9nbdj"] Jul 10 15:16:33.258730 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.258693 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:33.361607 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.361577 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:33.501092 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.501061 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4"] Jul 10 15:16:33.501597 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.501577 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="583e5830-3c4f-4b18-ac28-a9b3c583b737" containerName="istio-proxy" Jul 10 15:16:33.501655 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.501602 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="583e5830-3c4f-4b18-ac28-a9b3c583b737" containerName="istio-proxy" Jul 10 15:16:33.501655 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.501620 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3765fc5-b634-4ed5-a9a6-3497b2f25940" containerName="cleanup" Jul 10 15:16:33.501655 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.501630 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3765fc5-b634-4ed5-a9a6-3497b2f25940" containerName="cleanup" Jul 10 15:16:33.501752 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.501736 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3765fc5-b634-4ed5-a9a6-3497b2f25940" containerName="cleanup" Jul 10 15:16:33.501787 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.501750 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="583e5830-3c4f-4b18-ac28-a9b3c583b737" containerName="istio-proxy" Jul 10 15:16:33.506377 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.506357 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.511982 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.511928 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-65757421-openshift-default-dockercfg-85828\"" Jul 10 15:16:33.520137 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.520114 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4"] Jul 10 15:16:33.543413 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.543379 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:33.627471 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-credential-socket\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627621 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627475 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istiod-ca-cert\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627621 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-socket\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627621 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl2mm\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-kube-api-access-kl2mm\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627621 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-token\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627782 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627650 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-envoy\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627782 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627671 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-certs\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627782 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-data\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.627782 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.627715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-podinfo\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.643702 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.643671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:33.728633 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-podinfo\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.728728 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-credential-socket\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.728728 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728665 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istiod-ca-cert\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.728728 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-socket\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.728908 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl2mm\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-kube-api-access-kl2mm\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.728908 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728759 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-token\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.728908 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728796 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-envoy\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.729116 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728930 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-certs\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.729116 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.728960 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-data\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.729116 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.729105 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-credential-socket\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.729269 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.729143 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-socket\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.729334 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.729315 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-certs\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.729473 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.729452 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-data\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.729530 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.729514 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istiod-ca-cert\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.731126 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.731106 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-envoy\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.731292 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.731275 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-podinfo\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.737983 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.737961 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-token\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.739545 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.739526 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl2mm\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-kube-api-access-kl2mm\") pod \"e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.808040 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.807963 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="583e5830-3c4f-4b18-ac28-a9b3c583b737" path="/var/lib/kubelet/pods/583e5830-3c4f-4b18-ac28-a9b3c583b737/volumes" Jul 10 15:16:33.816114 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.816093 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:33.959024 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.959000 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4"] Jul 10 15:16:33.960944 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:16:33.960919 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbae5ba0_d8c6_4775_9275_de804f2e1c82.slice/crio-083fd0d48e9aaf557b49dac07d46c8362a9aebb4a870c4e9f187c91b398dc948 WatchSource:0}: Error finding container 083fd0d48e9aaf557b49dac07d46c8362a9aebb4a870c4e9f187c91b398dc948: Status 404 returned error can't find the container with id 083fd0d48e9aaf557b49dac07d46c8362a9aebb4a870c4e9f187c91b398dc948 Jul 10 15:16:33.964851 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.964319 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:33.964851 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.964503 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:33.964851 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:33.964616 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:16:34.306566 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:34.306528 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" event={"ID":"cbae5ba0-d8c6-4775-9275-de804f2e1c82","Type":"ContainerStarted","Data":"745b6328419f7af41d4c776a8b3d1e8672a70a0f8debc8d837fee098eb9533cb"} Jul 10 15:16:34.306949 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:34.306624 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" event={"ID":"cbae5ba0-d8c6-4775-9275-de804f2e1c82","Type":"ContainerStarted","Data":"083fd0d48e9aaf557b49dac07d46c8362a9aebb4a870c4e9f187c91b398dc948"} Jul 10 15:16:34.338097 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:34.338049 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" podStartSLOduration=1.33803367 podStartE2EDuration="1.33803367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:16:34.336076636 +0000 UTC m=+1897.202506951" watchObservedRunningTime="2026-07-10 15:16:34.33803367 +0000 UTC m=+1897.204463963" Jul 10 15:16:34.754721 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:34.754688 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:34.816480 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:34.816449 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:34.900893 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:34.900857 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:35.049292 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:35.049191 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:35.462630 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:35.462596 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:35.591098 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:35.591066 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:35.693165 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:35.693133 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:35.821458 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:35.821388 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:36.318109 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:36.318084 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:36.319097 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:36.319076 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:36.852579 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:36.852547 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:39.084034 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:39.083986 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:39.164754 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:39.164685 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:39.271001 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:39.270969 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4"] Jul 10 15:16:39.297921 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:39.297886 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:39.331450 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:39.331417 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" podUID="cbae5ba0-d8c6-4775-9275-de804f2e1c82" containerName="istio-proxy" containerID="cri-o://745b6328419f7af41d4c776a8b3d1e8672a70a0f8debc8d837fee098eb9533cb" gracePeriod=30 Jul 10 15:16:39.409544 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:39.409491 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:41.389035 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:41.388992 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:45.371866 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.371816 2572 generic.go:356] "Generic (PLEG): container finished" podID="cbae5ba0-d8c6-4775-9275-de804f2e1c82" containerID="745b6328419f7af41d4c776a8b3d1e8672a70a0f8debc8d837fee098eb9533cb" exitCode=0 Jul 10 15:16:45.372219 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.371895 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" event={"ID":"cbae5ba0-d8c6-4775-9275-de804f2e1c82","Type":"ContainerDied","Data":"745b6328419f7af41d4c776a8b3d1e8672a70a0f8debc8d837fee098eb9533cb"} Jul 10 15:16:45.384897 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.384868 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:45.515281 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.515210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:45.534955 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.534933 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-podinfo\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535086 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.534967 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-data\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535086 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.534992 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-token\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535086 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535030 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-socket\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535086 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535054 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-envoy\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535284 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535108 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-certs\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535284 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535146 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istiod-ca-cert\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535284 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535215 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-credential-socket\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535439 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535372 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:45.535610 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535592 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl2mm\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-kube-api-access-kl2mm\") pod \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\" (UID: \"cbae5ba0-d8c6-4775-9275-de804f2e1c82\") " Jul 10 15:16:45.535987 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535923 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:45.535987 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535942 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:45.535987 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.535532 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:16:45.536201 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.536053 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-data" (OuterVolumeSpecName: "istio-data") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:45.536265 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.536248 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-data\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.536326 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.536268 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.536326 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.536282 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-workload-certs\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.536326 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.536296 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istiod-ca-cert\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.536326 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.536309 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-credential-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.537518 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.537492 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 15:16:45.537762 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.537743 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:16:45.537963 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.537946 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-token" (OuterVolumeSpecName: "istio-token") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:16:45.538096 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.538073 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-kube-api-access-kl2mm" (OuterVolumeSpecName: "kube-api-access-kl2mm") pod "cbae5ba0-d8c6-4775-9275-de804f2e1c82" (UID: "cbae5ba0-d8c6-4775-9275-de804f2e1c82"). InnerVolumeSpecName "kube-api-access-kl2mm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:16:45.621962 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.621938 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:45.636872 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.636849 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-podinfo\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.636872 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.636867 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-token\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.636872 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.636876 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbae5ba0-d8c6-4775-9275-de804f2e1c82-istio-envoy\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:45.637082 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:45.636894 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl2mm\" (UniqueName: \"kubernetes.io/projected/cbae5ba0-d8c6-4775-9275-de804f2e1c82-kube-api-access-kl2mm\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:16:46.031739 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.031712 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:46.126065 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.125953 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:46.226700 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.226671 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:46.378195 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.378130 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" Jul 10 15:16:46.378195 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.378159 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4" event={"ID":"cbae5ba0-d8c6-4775-9275-de804f2e1c82","Type":"ContainerDied","Data":"083fd0d48e9aaf557b49dac07d46c8362a9aebb4a870c4e9f187c91b398dc948"} Jul 10 15:16:46.378603 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.378215 2572 scope.go:117] "RemoveContainer" containerID="745b6328419f7af41d4c776a8b3d1e8672a70a0f8debc8d837fee098eb9533cb" Jul 10 15:16:46.402310 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.402287 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4"] Jul 10 15:16:46.410700 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:46.410678 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-65757421-openshift-default-55df47fbc5-8tcw4"] Jul 10 15:16:47.697271 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:47.697234 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:47.807413 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:47.807386 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbae5ba0-d8c6-4775-9275-de804f2e1c82" path="/var/lib/kubelet/pods/cbae5ba0-d8c6-4775-9275-de804f2e1c82/volumes" Jul 10 15:16:54.867136 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:54.867097 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:54.978363 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:54.978321 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:55.065949 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:55.065916 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:55.167780 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:55.167722 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:16:55.625640 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:16:55.625556 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:21.746603 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:21.746565 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:27.633210 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:27.633169 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:27.740807 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:27.740777 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:27.834026 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:27.833999 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:43.935847 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:43.935790 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:49.732085 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:49.732052 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:49.800062 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:49.800022 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:49.971164 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:49.971131 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:17:50.088829 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:17:50.088729 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:00.598807 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:00.598771 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:01.507881 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:01.507845 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:07.446506 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:07.446469 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:08.855935 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:08.855898 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:08.955963 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:08.955926 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:10.846316 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:10.846283 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:16.819470 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:16.819430 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:16.923955 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:16.923909 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:17.609943 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:17.609908 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:23.669370 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:23.669324 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:23.770000 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:23.769962 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:23.939188 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:23.939111 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:24.275636 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.275553 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h"] Jul 10 15:18:24.275927 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.275914 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbae5ba0-d8c6-4775-9275-de804f2e1c82" containerName="istio-proxy" Jul 10 15:18:24.275981 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.275928 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbae5ba0-d8c6-4775-9275-de804f2e1c82" containerName="istio-proxy" Jul 10 15:18:24.276021 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.275997 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbae5ba0-d8c6-4775-9275-de804f2e1c82" containerName="istio-proxy" Jul 10 15:18:24.277751 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.277734 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.281865 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.281841 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-867db321-openshift-default-dockercfg-c8d5q\"" Jul 10 15:18:24.287465 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287435 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-podinfo\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287573 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-token\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287638 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287574 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-credential-socket\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-certs\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/390aba89-4228-4a9e-93e8-283c6a0e3a86-istiod-ca-cert\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287810 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287710 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-socket\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287810 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287736 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-envoy\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287810 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjzn\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-kube-api-access-xjjzn\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.287810 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.287801 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-data\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.302715 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.302695 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h"] Jul 10 15:18:24.306051 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.306020 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:24.388513 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-certs\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388716 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/390aba89-4228-4a9e-93e8-283c6a0e3a86-istiod-ca-cert\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388716 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-socket\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388716 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-envoy\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388716 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjzn\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-kube-api-access-xjjzn\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388968 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-data\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388968 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-podinfo\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388968 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388801 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-token\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388968 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-credential-socket\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.388968 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.388947 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-certs\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.389290 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.389020 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-socket\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.389290 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.389194 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-credential-socket\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.389399 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.389309 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/390aba89-4228-4a9e-93e8-283c6a0e3a86-istiod-ca-cert\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.389399 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.389354 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-data\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.390935 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.390912 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-envoy\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.391215 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.391199 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-podinfo\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.398971 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.398917 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-token\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.399498 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.399474 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjzn\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-kube-api-access-xjjzn\") pod \"e2e-mt-867db321-openshift-default-859f58b98c-57f4h\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.588092 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.588023 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:24.725980 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.725920 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h"] Jul 10 15:18:24.728792 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:18:24.728761 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390aba89_4228_4a9e_93e8_283c6a0e3a86.slice/crio-828bf2fc01c073adac4a071df28d371c074261d3f44fb2c233e2dc4e784dc1ff WatchSource:0}: Error finding container 828bf2fc01c073adac4a071df28d371c074261d3f44fb2c233e2dc4e784dc1ff: Status 404 returned error can't find the container with id 828bf2fc01c073adac4a071df28d371c074261d3f44fb2c233e2dc4e784dc1ff Jul 10 15:18:24.730812 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.730780 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:18:24.730946 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.730851 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:18:24.730946 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.730882 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:18:24.794760 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.794718 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:24.824339 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.824296 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" event={"ID":"390aba89-4228-4a9e-93e8-283c6a0e3a86","Type":"ContainerStarted","Data":"2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9"} Jul 10 15:18:24.824485 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.824372 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" event={"ID":"390aba89-4228-4a9e-93e8-283c6a0e3a86","Type":"ContainerStarted","Data":"828bf2fc01c073adac4a071df28d371c074261d3f44fb2c233e2dc4e784dc1ff"} Jul 10 15:18:24.849029 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:24.848926 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" podStartSLOduration=0.848904858 podStartE2EDuration="848.904858ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:18:24.847287693 +0000 UTC m=+2007.713718023" watchObservedRunningTime="2026-07-10 15:18:24.848904858 +0000 UTC m=+2007.715335153" Jul 10 15:18:25.588876 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:25.588816 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:25.593511 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:25.593487 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:25.828297 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:25.828265 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:25.829238 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:25.829214 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:18:27.332733 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:27.332698 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:27.429766 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:27.429732 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:31.963328 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:31.963297 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:34.358112 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:34.358072 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:18:34.460168 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:18:34.460144 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:19:57.732639 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:19:57.732611 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:19:57.735573 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:19:57.735548 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:19:57.736759 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:19:57.736740 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:19:57.739659 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:19:57.739638 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:20:15.925481 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:20:15.925434 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:20:38.972390 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:20:38.972314 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:20:39.026300 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:20:39.026270 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:37.247536 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:37.247494 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:37.608004 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:37.607918 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:44.027222 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:44.027177 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:44.157221 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:44.157189 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:44.277171 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:44.277139 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h"] Jul 10 15:21:44.277406 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:44.277328 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" podUID="390aba89-4228-4a9e-93e8-283c6a0e3a86" containerName="istio-proxy" containerID="cri-o://2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9" gracePeriod=30 Jul 10 15:21:44.294131 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:44.294080 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:44.736139 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:44.736107 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:44.829404 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:44.829374 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:45.010782 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:45.010707 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:49.531772 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.531750 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:21:49.658411 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658386 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjjzn\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-kube-api-access-xjjzn\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658524 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658423 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-envoy\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658524 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658463 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-podinfo\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658524 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658506 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/390aba89-4228-4a9e-93e8-283c6a0e3a86-istiod-ca-cert\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658661 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658525 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-data\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658661 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658557 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-token\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658661 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658580 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-socket\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658661 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658607 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-certs\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658661 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658638 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-credential-socket\") pod \"390aba89-4228-4a9e-93e8-283c6a0e3a86\" (UID: \"390aba89-4228-4a9e-93e8-283c6a0e3a86\") " Jul 10 15:21:49.658952 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658854 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-data" (OuterVolumeSpecName: "istio-data") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:21:49.659016 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658953 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-data\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.659016 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.658954 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/390aba89-4228-4a9e-93e8-283c6a0e3a86-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:21:49.659124 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.659094 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:21:49.659208 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.659188 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:21:49.659258 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.659199 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:21:49.660583 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.660560 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:21:49.660693 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.660609 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-kube-api-access-xjjzn" (OuterVolumeSpecName: "kube-api-access-xjjzn") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "kube-api-access-xjjzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:21:49.660981 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.660963 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 15:21:49.661036 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.660999 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-token" (OuterVolumeSpecName: "istio-token") pod "390aba89-4228-4a9e-93e8-283c6a0e3a86" (UID: "390aba89-4228-4a9e-93e8-283c6a0e3a86"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:21:49.722535 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.722512 2572 generic.go:356] "Generic (PLEG): container finished" podID="390aba89-4228-4a9e-93e8-283c6a0e3a86" containerID="2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9" exitCode=0 Jul 10 15:21:49.722641 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.722554 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" Jul 10 15:21:49.722641 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.722602 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" event={"ID":"390aba89-4228-4a9e-93e8-283c6a0e3a86","Type":"ContainerDied","Data":"2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9"} Jul 10 15:21:49.722714 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.722649 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h" event={"ID":"390aba89-4228-4a9e-93e8-283c6a0e3a86","Type":"ContainerDied","Data":"828bf2fc01c073adac4a071df28d371c074261d3f44fb2c233e2dc4e784dc1ff"} Jul 10 15:21:49.722714 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.722675 2572 scope.go:117] "RemoveContainer" containerID="2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9" Jul 10 15:21:49.731570 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.731555 2572 scope.go:117] "RemoveContainer" containerID="2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9" Jul 10 15:21:49.731810 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:21:49.731793 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9\": container with ID starting with 2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9 not found: ID does not exist" containerID="2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9" Jul 10 15:21:49.731879 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.731829 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9"} err="failed to get container status \"2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9\": rpc error: code = NotFound desc = could not find container \"2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9\": container with ID starting with 2c0c51611107182fa1f85ce148f61b34ec00ab930c316895284b316c754fcef9 not found: ID does not exist" Jul 10 15:21:49.747319 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.747295 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h"] Jul 10 15:21:49.752120 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.752099 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-867db321-openshift-default-859f58b98c-57f4h"] Jul 10 15:21:49.759676 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759661 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-podinfo\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.759748 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759678 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/390aba89-4228-4a9e-93e8-283c6a0e3a86-istiod-ca-cert\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.759748 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759686 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-token\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.759748 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759694 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.759748 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759702 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-workload-certs\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.759748 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759711 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-credential-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.759748 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759719 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjjzn\" (UniqueName: \"kubernetes.io/projected/390aba89-4228-4a9e-93e8-283c6a0e3a86-kube-api-access-xjjzn\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.759748 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.759728 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/390aba89-4228-4a9e-93e8-283c6a0e3a86-istio-envoy\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:21:49.807193 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:49.807173 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="390aba89-4228-4a9e-93e8-283c6a0e3a86" path="/var/lib/kubelet/pods/390aba89-4228-4a9e-93e8-283c6a0e3a86/volumes" Jul 10 15:21:51.831206 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:51.831165 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:51.936507 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:51.936474 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:52.031086 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:52.031061 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:52.201936 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:52.201911 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:58.312546 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:58.312508 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:21:58.377966 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:21:58.377925 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:22:05.147205 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.147168 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:22:05.425762 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.425683 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4"] Jul 10 15:22:05.426078 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.426064 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="390aba89-4228-4a9e-93e8-283c6a0e3a86" containerName="istio-proxy" Jul 10 15:22:05.426126 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.426079 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="390aba89-4228-4a9e-93e8-283c6a0e3a86" containerName="istio-proxy" Jul 10 15:22:05.426164 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.426152 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="390aba89-4228-4a9e-93e8-283c6a0e3a86" containerName="istio-proxy" Jul 10 15:22:05.427812 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.427791 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.430450 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.430433 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c21f337f-openshift-default-dockercfg-66cbt\"" Jul 10 15:22:05.440074 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.440049 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4"] Jul 10 15:22:05.452698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.452675 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:22:05.591551 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591518 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istiod-ca-cert\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.591761 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591570 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-envoy\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.591761 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-credential-socket\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.591761 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-data\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.591761 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-socket\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.591761 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591658 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hggn5\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-kube-api-access-hggn5\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.591761 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591729 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-certs\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.591761 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-podinfo\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.592148 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.591767 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-token\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.692921 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.692815 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-envoy\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.692921 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.692880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-credential-socket\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.692921 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.692900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-data\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.692934 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-socket\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.692951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hggn5\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-kube-api-access-hggn5\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.692975 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-certs\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.693095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-podinfo\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.693133 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-token\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.693179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istiod-ca-cert\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693504 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.693300 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-credential-socket\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693504 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.693358 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-data\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693806 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.693782 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-socket\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.693895 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.693811 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-certs\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.694088 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.694063 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istiod-ca-cert\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.695044 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.695025 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-envoy\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.695701 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.695674 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-podinfo\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.701116 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.701090 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-token\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.701437 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.701418 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hggn5\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-kube-api-access-hggn5\") pod \"e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.738247 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.738228 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:05.881302 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.881274 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4"] Jul 10 15:22:05.883605 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:22:05.883568 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3cfc35_2da1_4cce_a9b3_db4c27e8eba2.slice/crio-d1753465ac7780442057f392da0d1e7e662b7513162c051bf95044524e820a78 WatchSource:0}: Error finding container d1753465ac7780442057f392da0d1e7e662b7513162c051bf95044524e820a78: Status 404 returned error can't find the container with id d1753465ac7780442057f392da0d1e7e662b7513162c051bf95044524e820a78 Jul 10 15:22:05.886282 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.886235 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:22:05.886369 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.886325 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:22:05.886411 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.886368 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:22:05.915228 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:05.915199 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:22:06.802596 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:06.802566 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" event={"ID":"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2","Type":"ContainerStarted","Data":"cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7"} Jul 10 15:22:06.802979 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:06.802608 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" event={"ID":"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2","Type":"ContainerStarted","Data":"d1753465ac7780442057f392da0d1e7e662b7513162c051bf95044524e820a78"} Jul 10 15:22:07.738727 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:07.738691 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:07.743280 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:07.743257 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:07.764648 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:07.764607 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" podStartSLOduration=2.764592887 podStartE2EDuration="2.764592887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:22:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:22:06.821302628 +0000 UTC m=+2229.687732922" watchObservedRunningTime="2026-07-10 15:22:07.764592887 +0000 UTC m=+2230.631023180" Jul 10 15:22:07.807188 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:07.807164 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:07.807583 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:07.807566 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:22:08.731123 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:08.731061 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:22:08.830081 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:08.830047 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:22:13.269539 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:22:13.269505 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:23:58.335601 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:23:58.335525 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:24:57.759888 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:24:57.759860 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:24:57.763105 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:24:57.763082 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:24:57.763804 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:24:57.763784 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:24:57.766897 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:24:57.766880 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:25:17.968325 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:17.968295 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:18.391291 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:18.391261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:24.000841 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:24.000742 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:24.103119 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:24.103086 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:24.261443 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:24.261368 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4"] Jul 10 15:25:24.261606 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:24.261583 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" podUID="6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" containerName="istio-proxy" containerID="cri-o://cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7" gracePeriod=30 Jul 10 15:25:24.279499 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:24.279470 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:25.671683 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:25.671649 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:25.773994 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:25.773965 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:25.871718 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:25.871689 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:26.628216 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:26.628183 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:26.718064 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:26.718031 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:26.820207 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:26.820182 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:28.201341 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:28.201261 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:29.514144 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.514118 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:25:29.673287 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673248 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-credential-socket\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673477 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673293 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hggn5\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-kube-api-access-hggn5\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673477 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673323 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-data\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673477 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673345 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-envoy\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673477 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-certs\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673477 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673404 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-podinfo\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673477 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673466 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-socket\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673965 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673497 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-token\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673965 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673525 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istiod-ca-cert\") pod \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\" (UID: \"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2\") " Jul 10 15:25:29.673965 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673624 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:25:29.673965 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673724 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:25:29.673965 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673877 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:25:29.673965 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673936 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-credential-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.673965 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.673958 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-data\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.674324 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.674036 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:25:29.674324 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.674134 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:25:29.675933 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.675904 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-kube-api-access-hggn5" (OuterVolumeSpecName: "kube-api-access-hggn5") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "kube-api-access-hggn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:25:29.676075 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.675950 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:25:29.676075 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.675965 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 15:25:29.676317 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.676298 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" (UID: "6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:25:29.702958 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.702928 2572 generic.go:356] "Generic (PLEG): container finished" podID="6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" containerID="cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7" exitCode=0 Jul 10 15:25:29.703058 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.702998 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" Jul 10 15:25:29.703058 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.703017 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" event={"ID":"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2","Type":"ContainerDied","Data":"cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7"} Jul 10 15:25:29.703152 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.703108 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4" event={"ID":"6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2","Type":"ContainerDied","Data":"d1753465ac7780442057f392da0d1e7e662b7513162c051bf95044524e820a78"} Jul 10 15:25:29.703152 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.703135 2572 scope.go:117] "RemoveContainer" containerID="cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7" Jul 10 15:25:29.712522 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.712506 2572 scope.go:117] "RemoveContainer" containerID="cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7" Jul 10 15:25:29.712758 ip-10-0-133-29 kubenswrapper[2572]: E0710 15:25:29.712741 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7\": container with ID starting with cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7 not found: ID does not exist" containerID="cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7" Jul 10 15:25:29.712806 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.712766 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7"} err="failed to get container status \"cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7\": rpc error: code = NotFound desc = could not find container \"cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7\": container with ID starting with cffc8ff5c28786a044abd2075d8e9512ba0e151edaac020d99aa570f5f0840e7 not found: ID does not exist" Jul 10 15:25:29.725205 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.725180 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4"] Jul 10 15:25:29.728628 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.728606 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c21f337f-openshift-default-744c75f5f5-c98f4"] Jul 10 15:25:29.774562 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.774537 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-podinfo\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.774562 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.774557 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.774562 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.774565 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-token\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.774894 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.774575 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istiod-ca-cert\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.774894 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.774584 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hggn5\" (UniqueName: \"kubernetes.io/projected/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-kube-api-access-hggn5\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.774894 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.774592 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-istio-envoy\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.774894 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.774600 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2-workload-certs\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:25:29.808800 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:29.808763 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" path="/var/lib/kubelet/pods/6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2/volumes" Jul 10 15:25:33.944918 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:33.944868 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:34.020563 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:34.020532 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:34.627125 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:34.627095 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:40.381816 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:40.381781 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:40.492890 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:40.492859 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:40.582879 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:40.582815 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:51.121810 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:51.121769 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:25:51.613040 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:25:51.613011 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:06.860534 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:06.860502 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:12.482373 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:12.482332 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:18.332071 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.332012 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:18.390973 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.390944 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:18.691932 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.691884 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:18.974631 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.974557 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv"] Jul 10 15:26:18.974914 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.974901 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" containerName="istio-proxy" Jul 10 15:26:18.974963 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.974915 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" containerName="istio-proxy" Jul 10 15:26:18.974998 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.974986 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c3cfc35-2da1-4cce-a9b3-db4c27e8eba2" containerName="istio-proxy" Jul 10 15:26:18.978141 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.978121 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:18.980849 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.980809 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-566b18-openshift-default-dockercfg-qr4bf\"" Jul 10 15:26:18.989411 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:18.989389 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv"] Jul 10 15:26:19.002035 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.002013 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:19.046509 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-certs\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.046652 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046537 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-socket\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.046652 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046602 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgv62\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-kube-api-access-dgv62\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.046652 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046637 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-envoy\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.046854 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046687 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-podinfo\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.046854 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046711 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-token\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.046854 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791c113-4cfa-46d1-bc58-d96c23bdff14-istiod-ca-cert\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.047018 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046881 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-credential-socket\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.047018 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.046920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-data\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.147475 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147440 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-socket\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.147678 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147504 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgv62\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-kube-api-access-dgv62\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.147678 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-envoy\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.147678 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147590 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-podinfo\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.147678 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147615 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-token\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.147678 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147645 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791c113-4cfa-46d1-bc58-d96c23bdff14-istiod-ca-cert\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148020 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147717 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-credential-socket\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148020 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-data\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148020 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147784 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-certs\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148020 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.147931 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-socket\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148235 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.148120 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-certs\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148235 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.148202 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-credential-socket\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148927 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.148444 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-data\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.148927 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.148728 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791c113-4cfa-46d1-bc58-d96c23bdff14-istiod-ca-cert\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.151194 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.151169 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-envoy\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.151318 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.151197 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-podinfo\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.155166 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.155144 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-token\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.155690 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.155672 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgv62\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-kube-api-access-dgv62\") pod \"e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.210039 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.209974 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:19.289763 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.289683 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:19.429762 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.429736 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv"] Jul 10 15:26:19.432000 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:26:19.431971 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd791c113_4cfa_46d1_bc58_d96c23bdff14.slice/crio-580728476eaf3e6e7e3f29129e06fdffc1451a1588636a6be8574bc103192616 WatchSource:0}: Error finding container 580728476eaf3e6e7e3f29129e06fdffc1451a1588636a6be8574bc103192616: Status 404 returned error can't find the container with id 580728476eaf3e6e7e3f29129e06fdffc1451a1588636a6be8574bc103192616 Jul 10 15:26:19.434495 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.434466 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:26:19.434602 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.434543 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:26:19.434602 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.434585 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 10 15:26:19.924708 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.924674 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" event={"ID":"d791c113-4cfa-46d1-bc58-d96c23bdff14","Type":"ContainerStarted","Data":"00dbe29d94b356362aa085caac6083520fd1d52fbd21479f4657e6fd7f57bb63"} Jul 10 15:26:19.924886 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.924723 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" event={"ID":"d791c113-4cfa-46d1-bc58-d96c23bdff14","Type":"ContainerStarted","Data":"580728476eaf3e6e7e3f29129e06fdffc1451a1588636a6be8574bc103192616"} Jul 10 15:26:19.944729 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:19.944679 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" podStartSLOduration=1.944664293 podStartE2EDuration="1.944664293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:26:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:26:19.943155927 +0000 UTC m=+2482.809586223" watchObservedRunningTime="2026-07-10 15:26:19.944664293 +0000 UTC m=+2482.811094587" Jul 10 15:26:20.289945 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:20.289852 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:20.294909 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:20.294811 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:20.929647 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:20.929615 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:20.930561 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:20.930537 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:26:21.843616 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:21.843580 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:21.942783 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:21.942752 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:26.379974 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:26.379935 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:26:40.424381 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:26:40.424348 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:31.177763 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:31.177725 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:32.437998 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:32.437966 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:37.408404 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:37.408372 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:37.481090 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:37.481058 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:37.669587 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:37.669508 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv"] Jul 10 15:29:37.669788 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:37.669757 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" podUID="d791c113-4cfa-46d1-bc58-d96c23bdff14" containerName="istio-proxy" containerID="cri-o://00dbe29d94b356362aa085caac6083520fd1d52fbd21479f4657e6fd7f57bb63" gracePeriod=30 Jul 10 15:29:37.706188 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:37.706147 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:39.302246 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:39.302194 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564d6ffdfc-xz7cb_08b96d59-ceb7-46ce-b069-fbb87e1a6323/authorino/0.log" Jul 10 15:29:42.830901 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:42.830870 2572 generic.go:356] "Generic (PLEG): container finished" podID="d791c113-4cfa-46d1-bc58-d96c23bdff14" containerID="00dbe29d94b356362aa085caac6083520fd1d52fbd21479f4657e6fd7f57bb63" exitCode=0 Jul 10 15:29:42.831286 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:42.830925 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" event={"ID":"d791c113-4cfa-46d1-bc58-d96c23bdff14","Type":"ContainerDied","Data":"00dbe29d94b356362aa085caac6083520fd1d52fbd21479f4657e6fd7f57bb63"} Jul 10 15:29:42.926749 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:42.926727 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:29:43.014712 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014654 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-data\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.014712 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014705 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-socket\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.014906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014748 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-token\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.014906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014769 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-podinfo\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.014906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014799 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgv62\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-kube-api-access-dgv62\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.014906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014845 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-envoy\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.014906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014866 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791c113-4cfa-46d1-bc58-d96c23bdff14-istiod-ca-cert\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.014906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014890 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-credential-socket\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.015229 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014937 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-certs\") pod \"d791c113-4cfa-46d1-bc58-d96c23bdff14\" (UID: \"d791c113-4cfa-46d1-bc58-d96c23bdff14\") " Jul 10 15:29:43.015229 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014947 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-data" (OuterVolumeSpecName: "istio-data") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:29:43.015229 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.014960 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:29:43.015229 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.015194 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-data\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.015229 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.015201 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:29:43.015229 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.015213 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.015554 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.015282 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d791c113-4cfa-46d1-bc58-d96c23bdff14-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 15:29:43.015554 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.015418 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:29:43.017041 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.017005 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-token" (OuterVolumeSpecName: "istio-token") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:29:43.017041 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.017020 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-kube-api-access-dgv62" (OuterVolumeSpecName: "kube-api-access-dgv62") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "kube-api-access-dgv62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:29:43.017180 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.017022 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 10 15:29:43.017180 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.017090 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d791c113-4cfa-46d1-bc58-d96c23bdff14" (UID: "d791c113-4cfa-46d1-bc58-d96c23bdff14"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:29:43.116100 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.116068 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-token\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.116100 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.116097 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-podinfo\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.116100 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.116107 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgv62\" (UniqueName: \"kubernetes.io/projected/d791c113-4cfa-46d1-bc58-d96c23bdff14-kube-api-access-dgv62\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.116257 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.116115 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-istio-envoy\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.116257 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.116123 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d791c113-4cfa-46d1-bc58-d96c23bdff14-istiod-ca-cert\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.116257 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.116131 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-credential-socket\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.116257 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.116139 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d791c113-4cfa-46d1-bc58-d96c23bdff14-workload-certs\") on node \"ip-10-0-133-29.ec2.internal\" DevicePath \"\"" Jul 10 15:29:43.837243 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.837210 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" event={"ID":"d791c113-4cfa-46d1-bc58-d96c23bdff14","Type":"ContainerDied","Data":"580728476eaf3e6e7e3f29129e06fdffc1451a1588636a6be8574bc103192616"} Jul 10 15:29:43.837590 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.837266 2572 scope.go:117] "RemoveContainer" containerID="00dbe29d94b356362aa085caac6083520fd1d52fbd21479f4657e6fd7f57bb63" Jul 10 15:29:43.837590 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.837224 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv" Jul 10 15:29:43.856653 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.856627 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv"] Jul 10 15:29:43.861363 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:43.861338 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-566b18-openshift-default-5d6b85cf57-6xbvv"] Jul 10 15:29:44.892377 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:44.892350 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666496fd47-vn2bl_fafd72d7-0444-4888-a5a7-5d404e0622d5/copy-manifests/0.log" Jul 10 15:29:44.904777 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:44.904737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666496fd47-vn2bl_fafd72d7-0444-4888-a5a7-5d404e0622d5/manager/0.log" Jul 10 15:29:45.808657 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:45.808624 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d791c113-4cfa-46d1-bc58-d96c23bdff14" path="/var/lib/kubelet/pods/d791c113-4cfa-46d1-bc58-d96c23bdff14/volumes" Jul 10 15:29:46.205046 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:46.205021 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564d6ffdfc-xz7cb_08b96d59-ceb7-46ce-b069-fbb87e1a6323/authorino/0.log" Jul 10 15:29:46.795731 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:46.795702 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-j4csb_c1483756-8e0a-4e27-a39b-60b50662f8c3/manager/0.log" Jul 10 15:29:47.439536 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:47.439505 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789vg7m_27cda3b1-c886-46cb-bbb9-3d0db6c8afda/istio-proxy/0.log" Jul 10 15:29:47.904966 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:47.904939 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hrzr8_5c4dae81-aa2b-4677-b470-5e89309ef985/istio-proxy/1.log" Jul 10 15:29:48.252881 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:48.252811 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f4976748-f5s4v_4ce3dca2-270f-47dc-b47a-1ac7c17f041b/router/0.log" Jul 10 15:29:48.613237 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:48.613172 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-86kqp_1efb75ca-dadd-45a6-bf24-eeb154aa0bee/main/0.log" Jul 10 15:29:48.843490 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:48.843469 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-jvqmm_f652c39e-5d74-4a5c-a151-693b855f6352/main/0.log" Jul 10 15:29:53.865184 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.865096 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc474/must-gather-bn4cf"] Jul 10 15:29:53.865633 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.865598 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d791c113-4cfa-46d1-bc58-d96c23bdff14" containerName="istio-proxy" Jul 10 15:29:53.865633 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.865617 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d791c113-4cfa-46d1-bc58-d96c23bdff14" containerName="istio-proxy" Jul 10 15:29:53.865755 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.865716 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d791c113-4cfa-46d1-bc58-d96c23bdff14" containerName="istio-proxy" Jul 10 15:29:53.870611 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.870590 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:53.870611 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.870603 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:53.873017 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.872990 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc474\"/\"openshift-service-ca.crt\"" Jul 10 15:29:53.873017 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.873012 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bc474\"/\"kube-root-ca.crt\"" Jul 10 15:29:53.873844 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.873812 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bc474\"/\"default-dockercfg-4gfb9\"" Jul 10 15:29:53.878269 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.878244 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc474/must-gather-bn4cf"] Jul 10 15:29:53.931634 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.931599 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" limit=1024 Jul 10 15:29:53.992934 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.992903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4c1dd100-e601-4893-878e-6f0323bbef12-must-gather-output\") pod \"must-gather-bn4cf\" (UID: \"4c1dd100-e601-4893-878e-6f0323bbef12\") " pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:53.993027 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:53.992943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7hbj\" (UniqueName: \"kubernetes.io/projected/4c1dd100-e601-4893-878e-6f0323bbef12-kube-api-access-b7hbj\") pod \"must-gather-bn4cf\" (UID: \"4c1dd100-e601-4893-878e-6f0323bbef12\") " pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:54.093599 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.093565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7hbj\" (UniqueName: \"kubernetes.io/projected/4c1dd100-e601-4893-878e-6f0323bbef12-kube-api-access-b7hbj\") pod \"must-gather-bn4cf\" (UID: \"4c1dd100-e601-4893-878e-6f0323bbef12\") " pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:54.093746 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.093661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4c1dd100-e601-4893-878e-6f0323bbef12-must-gather-output\") pod \"must-gather-bn4cf\" (UID: \"4c1dd100-e601-4893-878e-6f0323bbef12\") " pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:54.093986 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.093969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4c1dd100-e601-4893-878e-6f0323bbef12-must-gather-output\") pod \"must-gather-bn4cf\" (UID: \"4c1dd100-e601-4893-878e-6f0323bbef12\") " pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:54.101691 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.101662 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7hbj\" (UniqueName: \"kubernetes.io/projected/4c1dd100-e601-4893-878e-6f0323bbef12-kube-api-access-b7hbj\") pod \"must-gather-bn4cf\" (UID: \"4c1dd100-e601-4893-878e-6f0323bbef12\") " pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:54.180996 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.180972 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc474/must-gather-bn4cf" Jul 10 15:29:54.307653 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.307623 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc474/must-gather-bn4cf"] Jul 10 15:29:54.309441 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:29:54.309413 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c1dd100_e601_4893_878e_6f0323bbef12.slice/crio-51b060ff3e0ad449bfaf2d00957195718c69e63f407764a0c149a5c9e63d6f72 WatchSource:0}: Error finding container 51b060ff3e0ad449bfaf2d00957195718c69e63f407764a0c149a5c9e63d6f72: Status 404 returned error can't find the container with id 51b060ff3e0ad449bfaf2d00957195718c69e63f407764a0c149a5c9e63d6f72 Jul 10 15:29:54.311753 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.311736 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 15:29:54.887192 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:54.887157 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc474/must-gather-bn4cf" event={"ID":"4c1dd100-e601-4893-878e-6f0323bbef12","Type":"ContainerStarted","Data":"51b060ff3e0ad449bfaf2d00957195718c69e63f407764a0c149a5c9e63d6f72"} Jul 10 15:29:55.904634 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:55.904593 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc474/must-gather-bn4cf" event={"ID":"4c1dd100-e601-4893-878e-6f0323bbef12","Type":"ContainerStarted","Data":"cc6c70a4182209f999f97c9010d7bbadebdb3b78e01b7cfff4b7584e486a855b"} Jul 10 15:29:55.905170 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:55.904651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc474/must-gather-bn4cf" event={"ID":"4c1dd100-e601-4893-878e-6f0323bbef12","Type":"ContainerStarted","Data":"a55a69ed22e777735a1c5dc8ea7fe0fd7d6e9f38fe1d098b6b184a2738b5896e"} Jul 10 15:29:55.920076 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:55.920019 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bc474/must-gather-bn4cf" podStartSLOduration=2.017931614 podStartE2EDuration="2.919997423s" totalImagesPullingTime="902.065809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:29:55.918329192 +0000 UTC m=+2698.784759514" watchObservedRunningTime="2026-07-10 15:29:55.919997423 +0000 UTC m=+2698.786427719" Jul 10 15:29:56.782129 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:56.782099 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hp7mt_cf80ce30-07ad-4e45-988b-735088a856b2/global-pull-secret-syncer/0.log" Jul 10 15:29:56.834983 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:56.834942 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hxz24_558ec33e-0f35-4c59-8fde-8e2566be2f5e/konnectivity-agent/0.log" Jul 10 15:29:56.919514 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:56.919467 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-29.ec2.internal_652befd04fb49fe2d61e157a118a9cc4/haproxy/0.log" Jul 10 15:29:57.791045 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:57.791012 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:29:57.794503 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:57.794480 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:29:57.795225 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:57.795198 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:29:57.799002 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:29:57.798983 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:30:01.516322 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:01.515839 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-564d6ffdfc-xz7cb_08b96d59-ceb7-46ce-b069-fbb87e1a6323/authorino/0.log" Jul 10 15:30:01.784896 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:01.784498 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-j4csb_c1483756-8e0a-4e27-a39b-60b50662f8c3/manager/0.log" Jul 10 15:30:03.616754 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:03.616713 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-bw5sh_d3d58457-f9df-4a93-b5a0-a20802e2b9cf/cluster-monitoring-operator/0.log" Jul 10 15:30:03.810565 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:03.810530 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-576jt_1b1b8871-5504-40bf-9a01-61b4b8eccd54/node-exporter/0.log" Jul 10 15:30:03.836958 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:03.836928 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-576jt_1b1b8871-5504-40bf-9a01-61b4b8eccd54/kube-rbac-proxy/0.log" Jul 10 15:30:03.866691 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:03.866662 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-576jt_1b1b8871-5504-40bf-9a01-61b4b8eccd54/init-textfile/0.log" Jul 10 15:30:05.877123 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:05.877090 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-dngbl_58d4c9fa-2a14-4269-8445-26c260e0fe5b/networking-console-plugin/0.log" Jul 10 15:30:06.491363 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.491333 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/2.log" Jul 10 15:30:06.497214 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.497156 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mxf5k_39a791a9-9f83-40a1-af78-f63ebea452b6/console-operator/3.log" Jul 10 15:30:06.700599 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.700559 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6"] Jul 10 15:30:06.705581 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.705554 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.711968 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.711938 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6"] Jul 10 15:30:06.728238 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.727679 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-proc\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.728238 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.727720 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-podres\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.728238 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.727746 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-sys\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.728238 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.727768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-lib-modules\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.728238 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.727941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm9cn\" (UniqueName: \"kubernetes.io/projected/925cb10a-decb-42a2-b977-11315d7f115a-kube-api-access-xm9cn\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.829115 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.829029 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm9cn\" (UniqueName: \"kubernetes.io/projected/925cb10a-decb-42a2-b977-11315d7f115a-kube-api-access-xm9cn\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.829461 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.829432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-proc\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.829586 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.829471 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-podres\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.829586 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.829495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-sys\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.829586 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.829519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-lib-modules\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.830212 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.830186 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-podres\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.830638 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.830234 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-sys\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.830765 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.830343 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-lib-modules\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.830885 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.830601 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/925cb10a-decb-42a2-b977-11315d7f115a-proc\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:06.838483 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:06.838462 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm9cn\" (UniqueName: \"kubernetes.io/projected/925cb10a-decb-42a2-b977-11315d7f115a-kube-api-access-xm9cn\") pod \"perf-node-gather-daemonset-rdxw6\" (UID: \"925cb10a-decb-42a2-b977-11315d7f115a\") " pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:07.018184 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:07.018151 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:07.186932 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:07.186700 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6"] Jul 10 15:30:07.189980 ip-10-0-133-29 kubenswrapper[2572]: W0710 15:30:07.189950 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod925cb10a_decb_42a2_b977_11315d7f115a.slice/crio-cdf40c73b16f4bf0c00b993ef816846dea2cffe04783036b9ccba276ae3955a8 WatchSource:0}: Error finding container cdf40c73b16f4bf0c00b993ef816846dea2cffe04783036b9ccba276ae3955a8: Status 404 returned error can't find the container with id cdf40c73b16f4bf0c00b993ef816846dea2cffe04783036b9ccba276ae3955a8 Jul 10 15:30:07.695123 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:07.695096 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-tn9g8_7b37164e-7bef-4517-a76b-8bdd9c8b4e71/volume-data-source-validator/0.log" Jul 10 15:30:07.987906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:07.987654 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" event={"ID":"925cb10a-decb-42a2-b977-11315d7f115a","Type":"ContainerStarted","Data":"34b34a007e98ff5e81c52db3393084db325441182273544bb199ffb56d8c2940"} Jul 10 15:30:07.987906 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:07.987721 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" event={"ID":"925cb10a-decb-42a2-b977-11315d7f115a","Type":"ContainerStarted","Data":"cdf40c73b16f4bf0c00b993ef816846dea2cffe04783036b9ccba276ae3955a8"} Jul 10 15:30:07.988681 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:07.988504 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:08.007544 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:08.007490 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" podStartSLOduration=2.00747243 podStartE2EDuration="2.00747243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:30:08.004755682 +0000 UTC m=+2710.871185980" watchObservedRunningTime="2026-07-10 15:30:08.00747243 +0000 UTC m=+2710.873902727" Jul 10 15:30:08.685744 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:08.685718 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5v76q_16d26c4e-bf87-4cb7-bf2f-b317d5500cc4/dns/0.log" Jul 10 15:30:08.706791 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:08.706741 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5v76q_16d26c4e-bf87-4cb7-bf2f-b317d5500cc4/kube-rbac-proxy/0.log" Jul 10 15:30:08.865139 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:08.865106 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pkv9v_b9adadb8-1cc0-48ab-ad0f-52a587f7abf3/dns-node-resolver/0.log" Jul 10 15:30:09.414277 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:09.414251 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sbzq6_668c6dc2-cade-4e9a-994f-cc374fdad086/node-ca/0.log" Jul 10 15:30:10.328220 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:10.328192 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789vg7m_27cda3b1-c886-46cb-bbb9-3d0db6c8afda/istio-proxy/0.log" Jul 10 15:30:10.464763 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:10.464733 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hrzr8_5c4dae81-aa2b-4677-b470-5e89309ef985/istio-proxy/0.log" Jul 10 15:30:10.499278 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:10.499246 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hrzr8_5c4dae81-aa2b-4677-b470-5e89309ef985/istio-proxy/1.log" Jul 10 15:30:10.607304 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:10.607239 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f4976748-f5s4v_4ce3dca2-270f-47dc-b47a-1ac7c17f041b/router/0.log" Jul 10 15:30:11.209998 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:11.209941 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dvjhp_6459c64f-420e-4b7f-ba05-c6b347b135e5/serve-healthcheck-canary/0.log" Jul 10 15:30:11.715235 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:11.715204 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-fgr4v_1d032ff4-1c76-47a0-8299-8dfa58ca6bf8/insights-operator/0.log" Jul 10 15:30:11.716002 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:11.715980 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-fgr4v_1d032ff4-1c76-47a0-8299-8dfa58ca6bf8/insights-operator/1.log" Jul 10 15:30:11.738391 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:11.738365 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgh22_e12c75e4-7905-4cb1-88df-1bb840f82a81/kube-rbac-proxy/0.log" Jul 10 15:30:11.759032 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:11.758987 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgh22_e12c75e4-7905-4cb1-88df-1bb840f82a81/exporter/0.log" Jul 10 15:30:11.778714 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:11.778687 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bgh22_e12c75e4-7905-4cb1-88df-1bb840f82a81/extractor/0.log" Jul 10 15:30:14.367512 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:14.367464 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666496fd47-vn2bl_fafd72d7-0444-4888-a5a7-5d404e0622d5/manager/0.log" Jul 10 15:30:14.385015 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:14.384991 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666496fd47-vn2bl_fafd72d7-0444-4888-a5a7-5d404e0622d5/copy-manifests/0.log" Jul 10 15:30:15.012027 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:15.011252 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bc474/perf-node-gather-daemonset-rdxw6" Jul 10 15:30:15.533280 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:15.533250 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cf7d8879d-mh66z_00803cf8-1650-4b85-8b32-4eed5c140a18/manager/0.log" Jul 10 15:30:16.470181 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:16.470131 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789vg7m_27cda3b1-c886-46cb-bbb9-3d0db6c8afda/istio-proxy/0.log" Jul 10 15:30:16.572009 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:16.571966 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hrzr8_5c4dae81-aa2b-4677-b470-5e89309ef985/istio-proxy/0.log" Jul 10 15:30:16.612214 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:16.612183 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hrzr8_5c4dae81-aa2b-4677-b470-5e89309ef985/istio-proxy/1.log" Jul 10 15:30:16.694013 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:16.693936 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f4976748-f5s4v_4ce3dca2-270f-47dc-b47a-1ac7c17f041b/router/0.log" Jul 10 15:30:18.016245 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:18.016217 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb6789vg7m_27cda3b1-c886-46cb-bbb9-3d0db6c8afda/istio-proxy/0.log" Jul 10 15:30:18.126698 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:18.126665 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hrzr8_5c4dae81-aa2b-4677-b470-5e89309ef985/istio-proxy/0.log" Jul 10 15:30:18.160579 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:18.160555 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-hrzr8_5c4dae81-aa2b-4677-b470-5e89309ef985/istio-proxy/1.log" Jul 10 15:30:18.237756 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:18.237730 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57f4976748-f5s4v_4ce3dca2-270f-47dc-b47a-1ac7c17f041b/router/0.log" Jul 10 15:30:20.830968 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:20.830941 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-24vgl_eab93726-2af6-4515-9afb-0d3660e8ff38/migrator/0.log" Jul 10 15:30:20.852032 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:20.852006 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-24vgl_eab93726-2af6-4515-9afb-0d3660e8ff38/graceful-termination/0.log" Jul 10 15:30:21.197296 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:21.197268 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-dlls9_dd5ada5a-d874-4cd9-89a7-ca7c73126866/kube-storage-version-migrator-operator/1.log" Jul 10 15:30:21.198103 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:21.198077 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-dlls9_dd5ada5a-d874-4cd9-89a7-ca7c73126866/kube-storage-version-migrator-operator/0.log" Jul 10 15:30:22.136259 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.136224 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-442lx_e2b84dc2-3e18-4ff5-ad0d-796ae845fec2/kube-multus-additional-cni-plugins/0.log" Jul 10 15:30:22.156603 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.156576 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-442lx_e2b84dc2-3e18-4ff5-ad0d-796ae845fec2/egress-router-binary-copy/0.log" Jul 10 15:30:22.176963 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.176940 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-442lx_e2b84dc2-3e18-4ff5-ad0d-796ae845fec2/cni-plugins/0.log" Jul 10 15:30:22.197926 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.197903 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-442lx_e2b84dc2-3e18-4ff5-ad0d-796ae845fec2/bond-cni-plugin/0.log" Jul 10 15:30:22.216805 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.216785 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-442lx_e2b84dc2-3e18-4ff5-ad0d-796ae845fec2/routeoverride-cni/0.log" Jul 10 15:30:22.237740 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.237721 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-442lx_e2b84dc2-3e18-4ff5-ad0d-796ae845fec2/whereabouts-cni-bincopy/0.log" Jul 10 15:30:22.257178 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.257158 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-442lx_e2b84dc2-3e18-4ff5-ad0d-796ae845fec2/whereabouts-cni/0.log" Jul 10 15:30:22.646132 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.646102 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-spdfh_b9a4ba6f-04fd-400e-b971-3a94cac6ab08/kube-multus/0.log" Jul 10 15:30:22.698670 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.698645 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cs6cg_7c25f2ef-9cec-48f5-9257-84db67d53ff7/network-metrics-daemon/0.log" Jul 10 15:30:22.717229 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:22.717205 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cs6cg_7c25f2ef-9cec-48f5-9257-84db67d53ff7/kube-rbac-proxy/0.log" Jul 10 15:30:23.808867 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.808809 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-controller/0.log" Jul 10 15:30:23.827205 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.827184 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/0.log" Jul 10 15:30:23.827205 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.827189 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovn-acl-logging/1.log" Jul 10 15:30:23.846995 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.846971 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/kube-rbac-proxy-node/0.log" Jul 10 15:30:23.868198 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.868174 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 15:30:23.889051 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.889034 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/northd/0.log" Jul 10 15:30:23.910155 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.910129 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/nbdb/0.log" Jul 10 15:30:23.930119 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.930099 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/sbdb/0.log" Jul 10 15:30:23.977206 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:23.977187 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-l8bbk_d226bb97-0bb0-4fb3-bc5a-f3a9220f9627/ovnkube-controller/0.log" Jul 10 15:30:25.276852 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:25.276809 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-n48nt_0f7278e3-9957-4dc1-8155-7fd34da42fba/check-endpoints/0.log" Jul 10 15:30:25.298191 ip-10-0-133-29 kubenswrapper[2572]: I0710 15:30:25.298166 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2pjg8_37bca1ba-3919-4eb0-a9a7-d2bc40dac515/network-check-target-container/0.log"