Jul 23 18:44:42.424549 ip-10-0-129-12 systemd[1]: Starting Kubernetes Kubelet... Jul 23 18:44:42.799396 ip-10-0-129-12 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:44:42.799396 ip-10-0-129-12 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 18:44:42.799396 ip-10-0-129-12 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:44:42.799396 ip-10-0-129-12 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 18:44:42.799396 ip-10-0-129-12 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:44:42.800055 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.799373 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 18:44:42.805447 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805425 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:44:42.805447 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805444 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:44:42.805447 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805447 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805451 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805455 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805459 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805462 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805464 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805467 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805470 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805473 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805476 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805478 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805481 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805491 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805496 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805500 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805512 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805516 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805519 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805522 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:44:42.805552 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805525 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805528 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805531 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805534 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805537 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805539 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805542 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805545 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805547 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805550 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805553 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805556 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805559 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805561 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805564 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805567 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805570 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805572 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805575 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805577 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:44:42.806004 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805580 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805582 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805585 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805590 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805594 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805598 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805601 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805604 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805606 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805609 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805611 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805614 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805616 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805619 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805622 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805624 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805628 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805630 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805633 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805635 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:44:42.806505 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805638 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805640 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805643 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805646 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805649 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805651 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805654 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805656 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805661 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805663 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805666 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805668 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805671 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805673 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805676 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805679 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805681 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805684 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805687 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:44:42.806986 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805690 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805692 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805695 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805698 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805700 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805703 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805705 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805709 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805712 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805714 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805717 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805719 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805722 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805724 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805728 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805732 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805735 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805737 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.805741 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:44:42.807457 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807329 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807338 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807341 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807345 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807348 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807351 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807355 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807358 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807361 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807364 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807367 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807370 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807373 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807376 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807379 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807381 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807384 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807386 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807389 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:44:42.807949 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807391 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807397 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807403 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807406 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807409 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807412 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807416 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807420 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807423 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807426 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807429 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807431 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807434 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807437 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807439 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807442 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807444 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807447 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807450 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:44:42.808474 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807452 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807455 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807457 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807460 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807463 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807465 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807468 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807470 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807474 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807476 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807479 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807482 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807484 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807486 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807490 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807492 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807495 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807498 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807501 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807503 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:44:42.808941 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807506 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807509 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807511 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807514 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807516 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807519 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807521 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807523 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807526 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807528 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807531 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807534 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807537 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807539 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807541 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807544 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807546 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807549 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807551 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:44:42.809456 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807554 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807556 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807560 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807563 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807565 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807568 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807570 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807573 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807576 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807579 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807581 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807584 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807586 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807589 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807591 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807593 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807596 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807598 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807601 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807603 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:44:42.809934 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807606 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.807608 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808000 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808006 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808008 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808011 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808013 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808016 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808021 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808024 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808028 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808031 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808034 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808036 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808040 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808042 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808045 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808047 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808051 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808054 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:44:42.810450 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808057 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808060 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808063 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808066 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808068 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808072 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808075 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808078 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808080 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808083 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808085 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808088 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808090 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808093 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808095 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808098 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808100 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808102 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808105 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:44:42.810938 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808107 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808110 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808112 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808115 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808117 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808120 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808122 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808125 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808128 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808130 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808133 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808135 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808139 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808141 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808144 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808146 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808149 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808151 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808153 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:44:42.811409 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808156 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808159 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808161 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808164 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808166 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808169 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808172 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808174 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808177 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808179 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808182 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808184 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808186 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808189 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808191 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808194 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808196 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808198 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808201 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808203 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:44:42.811864 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808206 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808208 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808211 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808213 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808216 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808219 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808222 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808225 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808227 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808230 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808234 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808237 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808240 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808243 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808245 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808248 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808252 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808255 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808257 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808260 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:44:42.812368 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808284 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808289 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.808293 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808375 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808383 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808391 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808395 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808400 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808403 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808407 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808412 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808415 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808419 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808422 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808425 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808429 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808433 2563 flags.go:64] FLAG: --cgroup-root="" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808436 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808439 2563 flags.go:64] FLAG: --client-ca-file="" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808441 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808444 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808448 2563 flags.go:64] FLAG: --cluster-domain="" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808451 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808454 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 18:44:42.812893 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808457 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808461 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808464 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808467 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808470 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808473 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808476 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808483 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808486 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808489 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808492 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808496 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808499 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808502 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808505 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808508 2563 flags.go:64] FLAG: --enable-server="true" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808510 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808516 2563 flags.go:64] FLAG: --event-burst="100" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808519 2563 flags.go:64] FLAG: --event-qps="50" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808521 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808524 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808527 2563 flags.go:64] FLAG: --eviction-hard="" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808531 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808534 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808545 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 18:44:42.813486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808549 2563 flags.go:64] FLAG: --eviction-soft="" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808552 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808555 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808557 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808560 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808563 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808565 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808568 2563 flags.go:64] FLAG: --feature-gates="" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808572 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808575 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808578 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808580 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808583 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808586 2563 flags.go:64] FLAG: --help="false" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808591 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-12.ec2.internal" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808594 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808597 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808599 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808603 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808606 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808609 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808612 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808614 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 18:44:42.814103 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808617 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808620 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808622 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808625 2563 flags.go:64] FLAG: --kube-reserved="" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808628 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808630 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808633 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808636 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808639 2563 flags.go:64] FLAG: --lock-file="" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808649 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808652 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808655 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808660 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808663 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808666 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808668 2563 flags.go:64] FLAG: --logging-format="text" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808671 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808674 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808677 2563 flags.go:64] FLAG: --manifest-url="" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808680 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808685 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808688 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808692 2563 flags.go:64] FLAG: --max-pods="110" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808696 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808699 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 18:44:42.814745 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808702 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808705 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808708 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808711 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808714 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808721 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808724 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808727 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808730 2563 flags.go:64] FLAG: --pod-cidr="" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808733 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808739 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808742 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808745 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808748 2563 flags.go:64] FLAG: --port="10250" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808751 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808753 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a080f1284e7f3689" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808757 2563 flags.go:64] FLAG: --qos-reserved="" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808767 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808770 2563 flags.go:64] FLAG: --register-node="true" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808773 2563 flags.go:64] FLAG: --register-with-taints="" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808777 2563 flags.go:64] FLAG: --registry-burst="10" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808779 2563 flags.go:64] FLAG: --registry-qps="5" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808782 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808785 2563 flags.go:64] FLAG: --reserved-memory="" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808789 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 18:44:42.815487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808792 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808795 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808798 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808800 2563 flags.go:64] FLAG: --runonce="false" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808803 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808807 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808810 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808813 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808815 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808818 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808821 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808824 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808827 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808830 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808832 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808835 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808838 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808841 2563 flags.go:64] FLAG: --system-cgroups="" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808844 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808849 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808851 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808854 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808860 2563 flags.go:64] FLAG: --tls-min-version="" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808863 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808867 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 18:44:42.816121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808875 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808878 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808881 2563 flags.go:64] FLAG: --v="2" Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808885 2563 flags.go:64] FLAG: --version="false" Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808889 2563 flags.go:64] FLAG: --vmodule="" Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808893 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.808896 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809023 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809028 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809031 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809034 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809036 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809040 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809042 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809045 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809049 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809053 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809056 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809058 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809061 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809064 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:44:42.816777 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809067 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809070 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809072 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809075 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809077 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809080 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809082 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809085 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809087 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809090 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809095 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809097 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809102 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809105 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809107 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809110 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809112 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809115 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809117 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809120 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:44:42.817306 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809122 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809125 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809127 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809131 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809134 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809137 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809139 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809142 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809144 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809147 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809149 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809152 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809154 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809157 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809160 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809163 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809165 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809168 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809171 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809173 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:44:42.817803 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809176 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809178 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809182 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809185 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809188 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809192 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809194 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809197 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809199 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809202 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809204 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809207 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809210 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809212 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809215 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809218 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809221 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809223 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809226 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:44:42.818388 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809229 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809231 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809234 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809236 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809239 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809241 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809245 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809248 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809251 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809254 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809257 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809259 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809277 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809282 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809285 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809291 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809294 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809297 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809300 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:44:42.818853 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809304 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809306 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809309 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809312 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809314 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809317 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.809319 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.809966 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.817575 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.817590 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.817609 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.817614 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817667 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817672 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:44:42.819325 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817676 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817679 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817681 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817684 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817687 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817690 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817692 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817695 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817698 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817701 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817703 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817706 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817709 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817711 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817714 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817717 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817719 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817722 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817726 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817728 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:44:42.819670 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817731 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817733 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817736 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817738 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817741 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817743 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817746 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817749 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817752 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817755 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817757 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817760 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817762 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817765 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817767 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817770 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817773 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817775 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817778 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817780 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:44:42.820144 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817783 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817785 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817788 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817790 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817792 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817795 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817797 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817800 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817802 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817805 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817809 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817813 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817817 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817820 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817823 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817825 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817828 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817830 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817833 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:44:42.820640 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817836 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817840 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817844 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817846 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817849 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817852 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817855 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817858 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817860 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817863 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817865 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817868 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817870 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817873 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817875 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817877 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817880 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817882 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817885 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:44:42.821083 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817888 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817890 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817892 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817895 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817897 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817900 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817903 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817905 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817908 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817911 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817913 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817916 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817918 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817921 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817924 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817927 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817931 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817934 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:44:42.821563 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.817937 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.817942 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818052 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818057 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818060 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818063 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818066 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818069 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818071 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818074 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818077 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818079 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818082 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818084 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:44:42.822007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818087 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818089 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818092 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818094 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818096 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818099 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818101 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818104 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818107 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818109 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818112 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818114 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818117 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818120 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818123 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818127 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818130 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818133 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818136 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818139 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:44:42.822460 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818141 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818144 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818146 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818149 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818152 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818154 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818156 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818159 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818161 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818164 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818166 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818169 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818171 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818174 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818176 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818179 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818181 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818183 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818186 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818188 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:44:42.822932 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818191 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818194 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818196 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818198 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818201 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818204 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818206 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818209 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818211 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818214 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818216 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818219 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818221 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818224 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818226 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818229 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818231 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818234 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818237 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:44:42.823429 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818240 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818243 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818246 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818248 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818251 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818253 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818256 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818258 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818261 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818280 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818283 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818286 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818288 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818291 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818294 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818296 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818299 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818301 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818304 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:44:42.823883 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818309 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818312 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818314 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818317 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818319 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818322 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818324 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818327 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:42.818330 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.818335 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.818443 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.820630 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.821905 2563 server.go:1019] "Starting client certificate rotation" Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.822010 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:44:42.824343 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.822048 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:44:42.824683 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.824489 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:44:42.829559 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.829534 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:44:42.840649 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.840631 2563 log.go:25] "Validated CRI v1 runtime API" Jul 23 18:44:42.843944 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.843928 2563 log.go:25] "Validated CRI v1 image API" Jul 23 18:44:42.845188 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.845167 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 18:44:42.847345 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.847324 2563 fs.go:135] Filesystem UUIDs: map[1081c6a1-b303-4d4d-ba25-c38b4528b7f1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f8860665-fd16-41cc-a950-ea0f2fc26d38:/dev/nvme0n1p4] Jul 23 18:44:42.847389 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.847346 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 18:44:42.852661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.852544 2563 manager.go:216] Machine: {Timestamp:2026-07-23 18:44:42.851305003 +0000 UTC m=+0.312964045 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3080752 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239974ca17e8844b87196904570bea SystemUUID:ec239974-ca17-e884-4b87-196904570bea BootID:da475884-ad51-46db-acc6-6021fc09439f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:de:cb:70:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:de:cb:70:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:08:8c:a5:9a:21 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 18:44:42.852661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.852651 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 18:44:42.852794 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.852728 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 18:44:42.855739 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.855709 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 18:44:42.855871 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.855740 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 18:44:42.856157 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.856135 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:44:42.856434 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.856421 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 18:44:42.856490 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.856440 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 18:44:42.856490 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.856451 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:44:42.857188 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.857176 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:44:42.858329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.858317 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 18:44:42.861335 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.861321 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:44:42.861520 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.861500 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 18:44:42.861580 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.861549 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 23 18:44:42.861580 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.861571 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 18:44:42.861668 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.861594 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 18:44:42.861668 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.861608 2563 kubelet.go:398] "Adding apiserver pod source" Jul 23 18:44:42.861668 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.861620 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 18:44:42.862043 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.862029 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:44:42.862111 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.862053 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:44:42.864134 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.864110 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 18:44:42.866132 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.866112 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 18:44:42.866180 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.866151 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 18:44:42.867206 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867194 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 18:44:42.867254 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867215 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 18:44:42.867254 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867224 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 18:44:42.867254 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867233 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 18:44:42.867254 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867244 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 18:44:42.867254 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867252 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 18:44:42.867409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867279 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 18:44:42.867409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867290 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 18:44:42.867409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867307 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 18:44:42.867409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867313 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 18:44:42.867409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867321 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 18:44:42.867409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.867326 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 18:44:42.868125 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.868116 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 18:44:42.868125 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.868124 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 18:44:42.871314 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.871291 2563 server.go:1268] "Started kubelet" Jul 23 18:44:42.871400 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.871375 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 18:44:42.875147 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.871508 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 18:44:42.875243 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.875182 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 18:44:42.876169 ip-10-0-129-12 systemd[1]: Started Kubernetes Kubelet. Jul 23 18:44:42.877115 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.876994 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 18:44:42.878281 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.878241 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 18:44:42.879561 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.879545 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 23 18:44:42.881675 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.881656 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 18:44:42.881745 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.881706 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 18:44:42.882218 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.882194 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 18:44:42.882516 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.881628 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c4ff813c30c790 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-23 18:44:42.87125288 +0000 UTC m=+0.332911925,LastTimestamp:2026-07-23 18:44:42.87125288 +0000 UTC m=+0.332911925,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}" Jul 23 18:44:42.883470 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.883447 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 18:44:42.883470 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.883464 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 18:44:42.883638 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.883619 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:42.884226 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884207 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 18:44:42.884226 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884227 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 18:44:42.884380 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884215 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 18:44:42.884380 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884348 2563 factory.go:55] Registering systemd factory Jul 23 18:44:42.884380 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884359 2563 factory.go:223] Registration of the systemd container factory successfully Jul 23 18:44:42.884493 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884391 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 23 18:44:42.884493 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884399 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 23 18:44:42.884725 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884712 2563 factory.go:153] Registering CRI-O factory Jul 23 18:44:42.884725 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884725 2563 factory.go:223] Registration of the crio container factory successfully Jul 23 18:44:42.884811 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884783 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 18:44:42.884811 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884802 2563 factory.go:103] Registering Raw factory Jul 23 18:44:42.884925 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.884816 2563 manager.go:1196] Started watching for new ooms in manager Jul 23 18:44:42.885535 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.885520 2563 manager.go:349] Starting recovery of all containers Jul 23 18:44:42.885618 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.885581 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 18:44:42.886497 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.886475 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 18:44:42.896201 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.896170 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klfgb" Jul 23 18:44:42.896577 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.896559 2563 manager.go:354] Recovery completed Jul 23 18:44:42.898418 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.898216 2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 23 18:44:42.901248 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.901235 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:44:42.903159 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.903140 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:44:42.903225 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.903173 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:44:42.903225 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.903183 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:44:42.903737 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.903726 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:44:42.903809 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.903728 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 18:44:42.903809 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.903799 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 18:44:42.903897 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.903821 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:44:42.904455 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.904439 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:44:42.904518 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.904469 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:44:42.904518 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.904485 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:44:42.905005 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.904991 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-klfgb" Jul 23 18:44:42.906308 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.905867 2563 policy_none.go:49] "None policy: Start" Jul 23 18:44:42.906403 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.906387 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 18:44:42.906496 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.906481 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 18:44:42.906607 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.906317 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c4ff813e179fa4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-23 18:44:42.903158692 +0000 UTC m=+0.364817734,LastTimestamp:2026-07-23 18:44:42.903158692 +0000 UTC m=+0.364817734,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}" Jul 23 18:44:42.907784 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.907769 2563 policy_none.go:47] "Start" Jul 23 18:44:42.958817 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.958797 2563 manager.go:337] "Starting Device Plugin manager" Jul 23 18:44:42.958926 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.958834 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 18:44:42.958926 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.958849 2563 server.go:87] "Starting device plugin registration server" Jul 23 18:44:42.959141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.959120 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 18:44:42.959231 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.959138 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 18:44:42.959311 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.959227 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 18:44:42.959358 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.959327 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 18:44:42.959358 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:42.959337 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 18:44:42.959953 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.959932 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 18:44:42.960027 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:42.959989 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.047688 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.047645 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 18:44:43.048984 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.048882 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 18:44:43.048984 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.048914 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 18:44:43.048984 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.048939 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 18:44:43.048984 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.048969 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 18:44:43.053117 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.053066 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:44:43.059987 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.059975 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:44:43.060803 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.060787 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:44:43.060862 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.060825 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:44:43.060862 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.060842 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:44:43.060931 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.060867 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.070146 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.070132 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.070218 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.070151 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-12.ec2.internal\": node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.089514 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.089488 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.149959 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.149924 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"] Jul 23 18:44:43.150066 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.150011 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:44:43.151597 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.151576 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:44:43.151682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.151614 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:44:43.151682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.151627 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:44:43.153020 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153007 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:44:43.153144 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153128 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.153183 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153160 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:44:43.153782 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153767 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:44:43.153853 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153797 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:44:43.153853 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153811 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:44:43.153853 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153818 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:44:43.153853 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153840 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:44:43.153853 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.153850 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:44:43.155134 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.155120 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.155197 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.155149 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:44:43.155847 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.155830 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:44:43.155914 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.155863 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:44:43.155914 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.155878 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:44:43.182988 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.182959 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.186188 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.186162 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e17e7656d483e4d3ef5e945c0f2ca874-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"e17e7656d483e4d3ef5e945c0f2ca874\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.186302 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.186196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66def9ef3fe8dc15875b1a95d06a69c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"66def9ef3fe8dc15875b1a95d06a69c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.186302 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.186215 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66def9ef3fe8dc15875b1a95d06a69c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"66def9ef3fe8dc15875b1a95d06a69c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.187449 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.187434 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.189938 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.189924 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.286927 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.286895 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e17e7656d483e4d3ef5e945c0f2ca874-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"e17e7656d483e4d3ef5e945c0f2ca874\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.286927 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.286929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66def9ef3fe8dc15875b1a95d06a69c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"66def9ef3fe8dc15875b1a95d06a69c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.287098 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.286947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66def9ef3fe8dc15875b1a95d06a69c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"66def9ef3fe8dc15875b1a95d06a69c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.287098 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.286990 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/66def9ef3fe8dc15875b1a95d06a69c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"66def9ef3fe8dc15875b1a95d06a69c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.287098 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.287015 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/66def9ef3fe8dc15875b1a95d06a69c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"66def9ef3fe8dc15875b1a95d06a69c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.287098 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.287015 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e17e7656d483e4d3ef5e945c0f2ca874-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"e17e7656d483e4d3ef5e945c0f2ca874\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.290327 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.290307 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.390775 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.390695 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.486115 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.486077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.490847 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.490830 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:43.490906 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.490843 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.591983 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.591942 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.692553 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.692491 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.793101 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.793063 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.821236 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.821199 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 18:44:43.821654 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.821405 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:44:43.894360 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.894321 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:43.909133 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.909096 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:39:43 +0000 UTC" deadline="2028-01-18 00:03:26.160950187 +0000 UTC" Jul 23 18:44:43.909133 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:43.909125 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13037h18m42.251828898s" Jul 23 18:44:43.994464 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:43.994431 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found" Jul 23 18:44:44.008066 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.008025 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:44:44.037409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.037383 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:44:44.083967 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.083937 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" Jul 23 18:44:44.098694 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:44.098658 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode17e7656d483e4d3ef5e945c0f2ca874.slice/crio-064b6f68cde5f49c98f6a699b96d8bf4c035b7f707dd846e878000669ce4a4a9 WatchSource:0}: Error finding container 064b6f68cde5f49c98f6a699b96d8bf4c035b7f707dd846e878000669ce4a4a9: Status 404 returned error can't find the container with id 064b6f68cde5f49c98f6a699b96d8bf4c035b7f707dd846e878000669ce4a4a9 Jul 23 18:44:44.099066 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:44.099040 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66def9ef3fe8dc15875b1a95d06a69c6.slice/crio-34bfc99d9b322963ec13697041bfa3596b030611e770a40648c305345c217a6b WatchSource:0}: Error finding container 34bfc99d9b322963ec13697041bfa3596b030611e770a40648c305345c217a6b: Status 404 returned error can't find the container with id 34bfc99d9b322963ec13697041bfa3596b030611e770a40648c305345c217a6b Jul 23 18:44:44.103364 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.103330 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:44:44.104795 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.104778 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:44:44.105216 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.105195 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" Jul 23 18:44:44.119700 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.119675 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:44:44.396300 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.396189 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:44:44.863972 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.863876 2563 apiserver.go:52] "Watching apiserver" Jul 23 18:44:44.872104 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.872074 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 18:44:44.874470 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.874438 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jhgx6","openshift-multus/multus-pkbhs","openshift-network-operator/iptables-alerter-k76kq","openshift-ovn-kubernetes/ovnkube-node-26p9d","kube-system/global-pull-secret-syncer-x84vd","kube-system/konnectivity-agent-rrgpm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d","openshift-image-registry/node-ca-tm9rb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal","openshift-multus/multus-additional-cni-plugins-dbvr5","openshift-multus/network-metrics-daemon-l9qfg","openshift-network-diagnostics/network-check-target-gbcw5","kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cf4ts"] Jul 23 18:44:44.877219 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.877190 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.880367 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.880342 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:44.880481 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:44.880443 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:44.882089 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.881902 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 18:44:44.882089 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.881917 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-czswb\"" Jul 23 18:44:44.882534 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.882512 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 18:44:44.882652 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.882512 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 18:44:44.882652 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.882638 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:44.883701 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.883682 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 18:44:44.885371 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.885263 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:44:44.885532 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.885510 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 18:44:44.885612 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.885595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 18:44:44.885882 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.885865 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kslpx\"" Jul 23 18:44:44.886401 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.886384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.889338 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.889317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:44.889444 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:44.889400 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:44.889671 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.889645 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 18:44:44.889771 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.889730 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 18:44:44.889888 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.889867 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 18:44:44.889949 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.889908 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5blv6\"" Jul 23 18:44:44.890161 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.890138 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 18:44:44.891502 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.890663 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 18:44:44.891502 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.891207 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 18:44:44.892468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.892446 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:44.894696 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.894676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:44.897890 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.897868 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:44.899389 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.899367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 18:44:44.900018 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.899994 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xmm66\"" Jul 23 18:44:44.900292 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.900269 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xtwxw\"" Jul 23 18:44:44.900594 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.900573 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:44:44.900991 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.900969 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 18:44:44.901579 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.901559 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 18:44:44.901905 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.901879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:44.901975 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.901930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-node-log\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.901967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-env-overrides\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-device-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.902034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902037 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-systemd\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902228 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902070 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-var-lib-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902228 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902106 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-log-socket\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902228 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-cni-bin\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902228 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-cni-netd\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902228 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovnkube-script-lib\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902521 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb8ks\" (UniqueName: \"kubernetes.io/projected/a4958947-fc82-4833-bbf8-212b3ff010bb-kube-api-access-bb8ks\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:44.902521 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902275 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-etc-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902521 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902501 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-sys-fs\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.902682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4958947-fc82-4833-bbf8-212b3ff010bb-host-slash\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:44.902682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902609 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-ovn\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.902682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-registration-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.902682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt8p5\" (UniqueName: \"kubernetes.io/projected/5e889600-f076-4834-8a7b-90daf2a1fee1-kube-api-access-pt8p5\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:44.902682 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4958947-fc82-4833-bbf8-212b3ff010bb-iptables-alerter-script\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-kubelet\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902719 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-run-ovn-kubernetes\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902740 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt9vd\" (UniqueName: \"kubernetes.io/projected/063ef17e-7475-41a0-97ee-23898b14a662-kube-api-access-wt9vd\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rd2\" (UniqueName: \"kubernetes.io/projected/034c9bbb-b208-49f1-bbe4-6d4675c43405-kube-api-access-n8rd2\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902772 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902805 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-slash\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902827 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-systemd-units\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902880 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovnkube-config\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902901 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovn-node-metrics-cert\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902938 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.902967 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-etc-selinux\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.903027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.903024 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 18:44:44.903661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.903088 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:44:44.903661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.903107 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l92g6\"" Jul 23 18:44:44.903661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.903190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 18:44:44.903661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.903027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-run-netns\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:44.903661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.903243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-socket-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:44.905424 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.905402 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkbhs" Jul 23 18:44:44.908719 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.908701 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:44.910330 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.910309 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 18:44:44.910330 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.910329 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 18:44:44.911149 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.911104 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 18:44:44.911574 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.911554 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 18:44:44.911677 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.911558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 18:44:44.911677 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.911636 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zjvhn\"" Jul 23 18:44:44.911824 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.911807 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7fk5j\"" Jul 23 18:44:44.911989 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.911968 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 18:44:44.912251 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.912231 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:44.914810 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.914789 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:44.914899 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:44.914877 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:44:44.917296 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.917275 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 18:44:44.921874 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.921849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlddt\"" Jul 23 18:44:44.921981 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.921877 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 18:44:44.931684 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.931575 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2d74s" Jul 23 18:44:44.941298 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.940942 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2d74s" Jul 23 18:44:44.986322 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:44.986294 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 18:44:45.004100 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-lib-modules\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.004267 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54qs\" (UniqueName: \"kubernetes.io/projected/25daf9d9-2730-4655-b07c-33c60cb89832-kube-api-access-z54qs\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.004267 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4958947-fc82-4833-bbf8-212b3ff010bb-host-slash\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:45.004267 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004175 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.004267 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004202 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-kubelet\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.004267 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-run-ovn-kubernetes\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.004267 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt9vd\" (UniqueName: \"kubernetes.io/projected/063ef17e-7475-41a0-97ee-23898b14a662-kube-api-access-wt9vd\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004276 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ltx9\" (UniqueName: \"kubernetes.io/projected/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-kube-api-access-6ltx9\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysctl-conf\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004342 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-tuned\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004368 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-k8s-cni-cncf-io\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-multus-certs\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rd2\" (UniqueName: \"kubernetes.io/projected/034c9bbb-b208-49f1-bbe4-6d4675c43405-kube-api-access-n8rd2\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-cni-multus\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-hostroot\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/25daf9d9-2730-4655-b07c-33c60cb89832-multus-daemon-config\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004558 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-systemd-units\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovnkube-config\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004627 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.004698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e00077f0-0cf1-4564-8e70-03e238d3cc02-dbus\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004686 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-var-lib-kubelet\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004771 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-cnibin\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004797 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-etc-kubernetes\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004827 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkg2\" (UniqueName: \"kubernetes.io/projected/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-kube-api-access-xpkg2\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004970 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45f63750-cea4-431b-acfa-026bee9b3d99-konnectivity-ca\") pod \"konnectivity-agent-rrgpm\" (UID: \"45f63750-cea4-431b-acfa-026bee9b3d99\") " pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.004996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-systemd\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-var-lib-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005050 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-cni-bin\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-cni-netd\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005116 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovnkube-script-lib\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005167 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wjv8\" (UniqueName: \"kubernetes.io/projected/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-kube-api-access-2wjv8\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005195 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-conf-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-etc-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.005326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005252 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-sys-fs\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.006005 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005279 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzd46\" (UniqueName: \"kubernetes.io/projected/89657ad4-1c6e-4e7c-b48d-e911162cd051-kube-api-access-bzd46\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.006005 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005305 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysconfig\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.006005 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.005960 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-systemd-units\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006155 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006030 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-etc-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006155 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006104 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-sys-fs\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.006264 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006170 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-kubelet\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006264 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006216 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4958947-fc82-4833-bbf8-212b3ff010bb-host-slash\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:45.006397 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006268 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006397 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006313 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-var-lib-openvswitch\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006397 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-host\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.006557 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25daf9d9-2730-4655-b07c-33c60cb89832-cni-binary-copy\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.006557 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-netns\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.006557 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-kubelet\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.006557 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006495 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-ovn\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006738 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006641 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovnkube-config\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006810 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-registration-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.006867 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006833 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-tmp-dir\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.006867 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.006860 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:45.006964 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006905 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-systemd\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.006964 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.006931 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs podName:5e889600-f076-4834-8a7b-90daf2a1fee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:45.506909097 +0000 UTC m=+2.968568150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs") pod "network-metrics-daemon-l9qfg" (UID: "5e889600-f076-4834-8a7b-90daf2a1fee1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:45.007097 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007078 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-run-ovn-kubernetes\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.007157 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-registration-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.007217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007163 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-run-ovn\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.007217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.006861 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-modprobe-d\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.007217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007194 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-cni-bin\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.007217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007214 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-os-release\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.007465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007230 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-cni-netd\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.007465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007267 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt8p5\" (UniqueName: \"kubernetes.io/projected/5e889600-f076-4834-8a7b-90daf2a1fee1-kube-api-access-pt8p5\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:45.007465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4958947-fc82-4833-bbf8-212b3ff010bb-iptables-alerter-script\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:45.007465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-system-cni-dir\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.007465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-os-release\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.007713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-slash\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.007713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89657ad4-1c6e-4e7c-b48d-e911162cd051-serviceca\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.007713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007522 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e00077f0-0cf1-4564-8e70-03e238d3cc02-kubelet-config\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.007713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-tmp\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.007713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.007713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovn-node-metrics-cert\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.007713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007687 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovnkube-script-lib\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007923 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 18:44:45.008063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007947 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-slash\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.007686 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-etc-selinux\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cnibin\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-run-netns\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008122 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-socket-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45f63750-cea4-431b-acfa-026bee9b3d99-agent-certs\") pod \"konnectivity-agent-rrgpm\" (UID: \"45f63750-cea4-431b-acfa-026bee9b3d99\") " pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008179 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-sys\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-system-cni-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008271 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-cni-bin\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008272 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008277 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-run-netns\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008378 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-node-log\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-env-overrides\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008426 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-socket-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008404 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-etc-selinux\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008434 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-device-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008451 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4958947-fc82-4833-bbf8-212b3ff010bb-iptables-alerter-script\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008484 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-node-log\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008500 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-kubernetes\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008529 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/063ef17e-7475-41a0-97ee-23898b14a662-device-dir\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-socket-dir-parent\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-log-socket\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008721 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/034c9bbb-b208-49f1-bbe4-6d4675c43405-log-socket\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-hosts-file\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.008807 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysctl-d\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-cni-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb8ks\" (UniqueName: \"kubernetes.io/projected/a4958947-fc82-4833-bbf8-212b3ff010bb-kube-api-access-bb8ks\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008925 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89657ad4-1c6e-4e7c-b48d-e911162cd051-host\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.008986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.009052 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-systemd\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.009078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-run\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.009553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.009242 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/034c9bbb-b208-49f1-bbe4-6d4675c43405-env-overrides\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.011790 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.011749 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/034c9bbb-b208-49f1-bbe4-6d4675c43405-ovn-node-metrics-cert\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.029099 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.029069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt9vd\" (UniqueName: \"kubernetes.io/projected/063ef17e-7475-41a0-97ee-23898b14a662-kube-api-access-wt9vd\") pod \"aws-ebs-csi-driver-node-dqw7d\" (UID: \"063ef17e-7475-41a0-97ee-23898b14a662\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.030142 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.030116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb8ks\" (UniqueName: \"kubernetes.io/projected/a4958947-fc82-4833-bbf8-212b3ff010bb-kube-api-access-bb8ks\") pod \"iptables-alerter-k76kq\" (UID: \"a4958947-fc82-4833-bbf8-212b3ff010bb\") " pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:45.030800 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.030775 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rd2\" (UniqueName: \"kubernetes.io/projected/034c9bbb-b208-49f1-bbe4-6d4675c43405-kube-api-access-n8rd2\") pod \"ovnkube-node-26p9d\" (UID: \"034c9bbb-b208-49f1-bbe4-6d4675c43405\") " pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.031934 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.031911 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt8p5\" (UniqueName: \"kubernetes.io/projected/5e889600-f076-4834-8a7b-90daf2a1fee1-kube-api-access-pt8p5\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:45.053701 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.053648 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"66def9ef3fe8dc15875b1a95d06a69c6","Type":"ContainerStarted","Data":"34bfc99d9b322963ec13697041bfa3596b030611e770a40648c305345c217a6b"} Jul 23 18:44:45.055659 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.055631 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"e17e7656d483e4d3ef5e945c0f2ca874","Type":"ContainerStarted","Data":"064b6f68cde5f49c98f6a699b96d8bf4c035b7f707dd846e878000669ce4a4a9"} Jul 23 18:44:45.110030 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.109997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ltx9\" (UniqueName: \"kubernetes.io/projected/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-kube-api-access-6ltx9\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.110178 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysctl-conf\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.110178 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-tuned\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.110178 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-k8s-cni-cncf-io\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110178 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-multus-certs\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110178 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-cni-multus\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110178 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-hostroot\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/25daf9d9-2730-4655-b07c-33c60cb89832-multus-daemon-config\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110213 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e00077f0-0cf1-4564-8e70-03e238d3cc02-dbus\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110238 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysctl-conf\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110262 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110288 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-var-lib-kubelet\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-cnibin\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110324 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-hostroot\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110359 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-etc-kubernetes\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110399 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkg2\" (UniqueName: \"kubernetes.io/projected/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-kube-api-access-xpkg2\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110403 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-cni-multus\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45f63750-cea4-431b-acfa-026bee9b3d99-konnectivity-ca\") pod \"konnectivity-agent-rrgpm\" (UID: \"45f63750-cea4-431b-acfa-026bee9b3d99\") " pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110444 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-etc-kubernetes\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wjv8\" (UniqueName: \"kubernetes.io/projected/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-kube-api-access-2wjv8\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110494 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-var-lib-kubelet\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.110585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110504 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-conf-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzd46\" (UniqueName: \"kubernetes.io/projected/89657ad4-1c6e-4e7c-b48d-e911162cd051-kube-api-access-bzd46\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110540 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-cnibin\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110547 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e00077f0-0cf1-4564-8e70-03e238d3cc02-dbus\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110616 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-conf-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110559 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysconfig\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-host\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110711 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysconfig\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110758 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25daf9d9-2730-4655-b07c-33c60cb89832-cni-binary-copy\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-netns\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-kubelet\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.110829 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110874 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/25daf9d9-2730-4655-b07c-33c60cb89832-multus-daemon-config\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-netns\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110912 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110942 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-kubelet\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-tmp-dir\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110985 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-multus-certs\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.111468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.110354 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-run-k8s-cni-cncf-io\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-modprobe-d\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-os-release\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111112 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-system-cni-dir\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111127 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/45f63750-cea4-431b-acfa-026bee9b3d99-konnectivity-ca\") pod \"konnectivity-agent-rrgpm\" (UID: \"45f63750-cea4-431b-acfa-026bee9b3d99\") " pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111133 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-os-release\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111146 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-os-release\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89657ad4-1c6e-4e7c-b48d-e911162cd051-serviceca\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111195 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-tmp-dir\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e00077f0-0cf1-4564-8e70-03e238d3cc02-kubelet-config\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111219 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-os-release\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111241 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-tmp\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.111293 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret podName:e00077f0-0cf1-4564-8e70-03e238d3cc02 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:45.611273208 +0000 UTC m=+3.072932239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret") pod "global-pull-secret-syncer-x84vd" (UID: "e00077f0-0cf1-4564-8e70-03e238d3cc02") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111322 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/25daf9d9-2730-4655-b07c-33c60cb89832-cni-binary-copy\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111371 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-modprobe-d\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cnibin\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e00077f0-0cf1-4564-8e70-03e238d3cc02-kubelet-config\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.112385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111434 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-system-cni-dir\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111445 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cnibin\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45f63750-cea4-431b-acfa-026bee9b3d99-agent-certs\") pod \"konnectivity-agent-rrgpm\" (UID: \"45f63750-cea4-431b-acfa-026bee9b3d99\") " pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111493 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-host\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-sys\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-system-cni-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-cni-bin\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111613 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-kubernetes\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111643 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-system-cni-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111648 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-sys\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-socket-dir-parent\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111726 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89657ad4-1c6e-4e7c-b48d-e911162cd051-serviceca\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111737 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-hosts-file\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysctl-d\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-host-var-lib-cni-bin\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-cni-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111800 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-socket-dir-parent\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111821 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89657ad4-1c6e-4e7c-b48d-e911162cd051-host\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111771 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-kubernetes\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111868 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-sysctl-d\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111880 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89657ad4-1c6e-4e7c-b48d-e911162cd051-host\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111881 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-hosts-file\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111909 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/25daf9d9-2730-4655-b07c-33c60cb89832-multus-cni-dir\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111912 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.111975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-systemd\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-run\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112021 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112025 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-lib-modules\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54qs\" (UniqueName: \"kubernetes.io/projected/25daf9d9-2730-4655-b07c-33c60cb89832-kube-api-access-z54qs\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112124 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-lib-modules\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112132 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112178 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-run\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.112191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-systemd\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.113898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.113069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.114922 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.114865 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-tmp\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.115017 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.114925 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-etc-tuned\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.116809 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.116783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/45f63750-cea4-431b-acfa-026bee9b3d99-agent-certs\") pod \"konnectivity-agent-rrgpm\" (UID: \"45f63750-cea4-431b-acfa-026bee9b3d99\") " pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:45.123659 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.123638 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ltx9\" (UniqueName: \"kubernetes.io/projected/aa0aad2f-f17a-417a-9c46-4d4a1efdf3da-kube-api-access-6ltx9\") pod \"multus-additional-cni-plugins-dbvr5\" (UID: \"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da\") " pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.126004 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.125710 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:44:45.126004 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.125736 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:44:45.126004 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.125752 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xqp2l for pod openshift-network-diagnostics/network-check-target-gbcw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:45.126004 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.125823 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l podName:37421769-7624-4dc7-8132-2b261ee2b2bc nodeName:}" failed. No retries permitted until 2026-07-23 18:44:45.625801758 +0000 UTC m=+3.087460794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xqp2l" (UniqueName: "kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l") pod "network-check-target-gbcw5" (UID: "37421769-7624-4dc7-8132-2b261ee2b2bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:45.127584 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.127555 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54qs\" (UniqueName: \"kubernetes.io/projected/25daf9d9-2730-4655-b07c-33c60cb89832-kube-api-access-z54qs\") pod \"multus-pkbhs\" (UID: \"25daf9d9-2730-4655-b07c-33c60cb89832\") " pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.127697 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.127652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkg2\" (UniqueName: \"kubernetes.io/projected/7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f-kube-api-access-xpkg2\") pod \"node-resolver-jhgx6\" (UID: \"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f\") " pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.128654 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.128633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzd46\" (UniqueName: \"kubernetes.io/projected/89657ad4-1c6e-4e7c-b48d-e911162cd051-kube-api-access-bzd46\") pod \"node-ca-tm9rb\" (UID: \"89657ad4-1c6e-4e7c-b48d-e911162cd051\") " pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.128892 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.128870 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wjv8\" (UniqueName: \"kubernetes.io/projected/9eb87c8b-9085-41c3-a42e-a5f15e633aa3-kube-api-access-2wjv8\") pod \"tuned-cf4ts\" (UID: \"9eb87c8b-9085-41c3-a42e-a5f15e633aa3\") " pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.190463 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.190431 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" Jul 23 18:44:45.202484 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.202460 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k76kq" Jul 23 18:44:45.213035 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.212994 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:44:45.220881 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.220856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:44:45.227764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.227742 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" Jul 23 18:44:45.235510 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.235491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tm9rb" Jul 23 18:44:45.243333 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.243312 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pkbhs" Jul 23 18:44:45.253327 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.253284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" Jul 23 18:44:45.260306 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.260263 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jhgx6" Jul 23 18:44:45.402587 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.402503 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:44:45.473096 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.473060 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063ef17e_7475_41a0_97ee_23898b14a662.slice/crio-f8c3d8f4992e6720a53f3c473b392f716286e7a391693ad66beb1774c51f9cb6 WatchSource:0}: Error finding container f8c3d8f4992e6720a53f3c473b392f716286e7a391693ad66beb1774c51f9cb6: Status 404 returned error can't find the container with id f8c3d8f4992e6720a53f3c473b392f716286e7a391693ad66beb1774c51f9cb6 Jul 23 18:44:45.474080 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.474053 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffcc121_2ee8_448d_a9e5_b0e08c47fa1f.slice/crio-26319676169fd3a92e0bf67bc5d4db8cee68a518249a3c200a157fb3a2de8855 WatchSource:0}: Error finding container 26319676169fd3a92e0bf67bc5d4db8cee68a518249a3c200a157fb3a2de8855: Status 404 returned error can't find the container with id 26319676169fd3a92e0bf67bc5d4db8cee68a518249a3c200a157fb3a2de8855 Jul 23 18:44:45.476299 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.476256 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25daf9d9_2730_4655_b07c_33c60cb89832.slice/crio-f4ebeea7af15862285013da0e7cb3f66fe626e38d9106d7e82685f1cf442c951 WatchSource:0}: Error finding container f4ebeea7af15862285013da0e7cb3f66fe626e38d9106d7e82685f1cf442c951: Status 404 returned error can't find the container with id f4ebeea7af15862285013da0e7cb3f66fe626e38d9106d7e82685f1cf442c951 Jul 23 18:44:45.478926 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.478903 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89657ad4_1c6e_4e7c_b48d_e911162cd051.slice/crio-b3d7a1d24ece15161139199bba8e9f0274a0b78f9053bfb0ab0aa3598c5e2a77 WatchSource:0}: Error finding container b3d7a1d24ece15161139199bba8e9f0274a0b78f9053bfb0ab0aa3598c5e2a77: Status 404 returned error can't find the container with id b3d7a1d24ece15161139199bba8e9f0274a0b78f9053bfb0ab0aa3598c5e2a77 Jul 23 18:44:45.501695 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.501666 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb87c8b_9085_41c3_a42e_a5f15e633aa3.slice/crio-35d47711cda9e9e84919581a61684c163101a4e399d0d9744e7f85ae8b890281 WatchSource:0}: Error finding container 35d47711cda9e9e84919581a61684c163101a4e399d0d9744e7f85ae8b890281: Status 404 returned error can't find the container with id 35d47711cda9e9e84919581a61684c163101a4e399d0d9744e7f85ae8b890281 Jul 23 18:44:45.502858 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.502823 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4958947_fc82_4833_bbf8_212b3ff010bb.slice/crio-fec47ff52e55cb0e0f3d28d29d880cf9b567485eba101e741ba9fbfaad3007ca WatchSource:0}: Error finding container fec47ff52e55cb0e0f3d28d29d880cf9b567485eba101e741ba9fbfaad3007ca: Status 404 returned error can't find the container with id fec47ff52e55cb0e0f3d28d29d880cf9b567485eba101e741ba9fbfaad3007ca Jul 23 18:44:45.504380 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.504350 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0aad2f_f17a_417a_9c46_4d4a1efdf3da.slice/crio-5b429075fc4c20bfefb7a5b5a4b432f253cc6a8e6c516bfc64f6a88cf27622d1 WatchSource:0}: Error finding container 5b429075fc4c20bfefb7a5b5a4b432f253cc6a8e6c516bfc64f6a88cf27622d1: Status 404 returned error can't find the container with id 5b429075fc4c20bfefb7a5b5a4b432f253cc6a8e6c516bfc64f6a88cf27622d1 Jul 23 18:44:45.504702 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.504678 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f63750_cea4_431b_acfa_026bee9b3d99.slice/crio-b3545696106254d7bd4607c8edc92c693019040b2a870fd2fe195528100c6865 WatchSource:0}: Error finding container b3545696106254d7bd4607c8edc92c693019040b2a870fd2fe195528100c6865: Status 404 returned error can't find the container with id b3545696106254d7bd4607c8edc92c693019040b2a870fd2fe195528100c6865 Jul 23 18:44:45.506593 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:44:45.506569 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034c9bbb_b208_49f1_bbe4_6d4675c43405.slice/crio-e6e0b823a83818a86c9ddd8ae2c9011c21a0dacc854f49bde02f970b66f86731 WatchSource:0}: Error finding container e6e0b823a83818a86c9ddd8ae2c9011c21a0dacc854f49bde02f970b66f86731: Status 404 returned error can't find the container with id e6e0b823a83818a86c9ddd8ae2c9011c21a0dacc854f49bde02f970b66f86731 Jul 23 18:44:45.515576 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.514793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:45.515576 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.514916 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:45.515576 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.514958 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs podName:5e889600-f076-4834-8a7b-90daf2a1fee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:46.514945279 +0000 UTC m=+3.976604310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs") pod "network-metrics-daemon-l9qfg" (UID: "5e889600-f076-4834-8a7b-90daf2a1fee1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:45.615752 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.615717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:45.615940 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.615851 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:45.615940 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.615915 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret podName:e00077f0-0cf1-4564-8e70-03e238d3cc02 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:46.615896164 +0000 UTC m=+4.077555197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret") pod "global-pull-secret-syncer-x84vd" (UID: "e00077f0-0cf1-4564-8e70-03e238d3cc02") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:45.716557 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.716513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:45.716723 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.716661 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:44:45.716723 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.716689 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:44:45.716723 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.716700 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xqp2l for pod openshift-network-diagnostics/network-check-target-gbcw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:45.716876 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:45.716764 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l podName:37421769-7624-4dc7-8132-2b261ee2b2bc nodeName:}" failed. No retries permitted until 2026-07-23 18:44:46.716743443 +0000 UTC m=+4.178402499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqp2l" (UniqueName: "kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l") pod "network-check-target-gbcw5" (UID: "37421769-7624-4dc7-8132-2b261ee2b2bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:45.944904 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.944841 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:39:45 +0000 UTC" deadline="2028-03-28 23:03:49.199872523 +0000 UTC" Jul 23 18:44:45.944904 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:45.944894 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14740h19m3.254983027s" Jul 23 18:44:46.050013 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.049979 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:46.050203 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.050122 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:46.050203 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.050168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:46.050356 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.050269 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:46.058639 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.058602 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" event={"ID":"9eb87c8b-9085-41c3-a42e-a5f15e633aa3","Type":"ContainerStarted","Data":"35d47711cda9e9e84919581a61684c163101a4e399d0d9744e7f85ae8b890281"} Jul 23 18:44:46.059872 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.059844 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerStarted","Data":"5b429075fc4c20bfefb7a5b5a4b432f253cc6a8e6c516bfc64f6a88cf27622d1"} Jul 23 18:44:46.060995 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.060967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jhgx6" event={"ID":"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f","Type":"ContainerStarted","Data":"26319676169fd3a92e0bf67bc5d4db8cee68a518249a3c200a157fb3a2de8855"} Jul 23 18:44:46.063183 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.063156 2563 generic.go:356] "Generic (PLEG): container finished" podID="66def9ef3fe8dc15875b1a95d06a69c6" containerID="6773a83445fc85578b1f43f1e44ad36f821df63870f0dbc54b715d44b0083633" exitCode=0 Jul 23 18:44:46.063317 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.063257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"66def9ef3fe8dc15875b1a95d06a69c6","Type":"ContainerDied","Data":"6773a83445fc85578b1f43f1e44ad36f821df63870f0dbc54b715d44b0083633"} Jul 23 18:44:46.064546 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.064520 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rrgpm" event={"ID":"45f63750-cea4-431b-acfa-026bee9b3d99","Type":"ContainerStarted","Data":"b3545696106254d7bd4607c8edc92c693019040b2a870fd2fe195528100c6865"} Jul 23 18:44:46.065835 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.065806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"e6e0b823a83818a86c9ddd8ae2c9011c21a0dacc854f49bde02f970b66f86731"} Jul 23 18:44:46.067171 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.067147 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k76kq" event={"ID":"a4958947-fc82-4833-bbf8-212b3ff010bb","Type":"ContainerStarted","Data":"fec47ff52e55cb0e0f3d28d29d880cf9b567485eba101e741ba9fbfaad3007ca"} Jul 23 18:44:46.068553 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.068531 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tm9rb" event={"ID":"89657ad4-1c6e-4e7c-b48d-e911162cd051","Type":"ContainerStarted","Data":"b3d7a1d24ece15161139199bba8e9f0274a0b78f9053bfb0ab0aa3598c5e2a77"} Jul 23 18:44:46.069794 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.069773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkbhs" event={"ID":"25daf9d9-2730-4655-b07c-33c60cb89832","Type":"ContainerStarted","Data":"f4ebeea7af15862285013da0e7cb3f66fe626e38d9106d7e82685f1cf442c951"} Jul 23 18:44:46.070904 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.070877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" event={"ID":"063ef17e-7475-41a0-97ee-23898b14a662","Type":"ContainerStarted","Data":"f8c3d8f4992e6720a53f3c473b392f716286e7a391693ad66beb1774c51f9cb6"} Jul 23 18:44:46.524670 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.523985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:46.524670 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.524176 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:46.524670 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.524246 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs podName:5e889600-f076-4834-8a7b-90daf2a1fee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:48.524225394 +0000 UTC m=+5.985884444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs") pod "network-metrics-daemon-l9qfg" (UID: "5e889600-f076-4834-8a7b-90daf2a1fee1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:46.625263 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.624684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:46.625263 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.624836 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:46.625263 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.624901 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret podName:e00077f0-0cf1-4564-8e70-03e238d3cc02 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:48.624882816 +0000 UTC m=+6.086541852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret") pod "global-pull-secret-syncer-x84vd" (UID: "e00077f0-0cf1-4564-8e70-03e238d3cc02") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:46.725915 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.725873 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:46.726083 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.726055 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:44:46.726083 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.726080 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:44:46.726196 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.726095 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xqp2l for pod openshift-network-diagnostics/network-check-target-gbcw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:46.726196 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:46.726161 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l podName:37421769-7624-4dc7-8132-2b261ee2b2bc nodeName:}" failed. No retries permitted until 2026-07-23 18:44:48.726140437 +0000 UTC m=+6.187799492 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqp2l" (UniqueName: "kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l") pod "network-check-target-gbcw5" (UID: "37421769-7624-4dc7-8132-2b261ee2b2bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:46.945465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.945417 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:39:45 +0000 UTC" deadline="2028-02-03 15:12:00.244614539 +0000 UTC" Jul 23 18:44:46.945465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:46.945463 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13436h27m13.299156066s" Jul 23 18:44:47.052565 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:47.052483 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:47.052741 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:47.052618 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:44:47.084911 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:47.084172 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"e17e7656d483e4d3ef5e945c0f2ca874","Type":"ContainerStarted","Data":"598c0c2a97d836946a3b5cd96e262e40251554952eb1fcec78119ff8968f155b"} Jul 23 18:44:47.088322 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:47.088142 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"66def9ef3fe8dc15875b1a95d06a69c6","Type":"ContainerStarted","Data":"a1af25a369fb1a0a2eeacbd06027a6cb7d450013fe2e32b8dd81ec4acf16887e"} Jul 23 18:44:47.110805 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:47.110727 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" podStartSLOduration=3.110703207 podStartE2EDuration="3.110703207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:47.108809173 +0000 UTC m=+4.570468231" watchObservedRunningTime="2026-07-23 18:44:47.110703207 +0000 UTC m=+4.572362263" Jul 23 18:44:48.049820 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:48.049093 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:48.049820 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.049230 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:48.049820 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:48.049647 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:48.049820 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.049771 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:48.548517 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:48.547803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:48.548517 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.547989 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:48.548517 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.548070 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs podName:5e889600-f076-4834-8a7b-90daf2a1fee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:52.548049853 +0000 UTC m=+10.009708898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs") pod "network-metrics-daemon-l9qfg" (UID: "5e889600-f076-4834-8a7b-90daf2a1fee1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:48.649137 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:48.648803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:48.649137 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.649015 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:48.656392 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.649084 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret podName:e00077f0-0cf1-4564-8e70-03e238d3cc02 nodeName:}" failed. No retries permitted until 2026-07-23 18:44:52.649064179 +0000 UTC m=+10.110723227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret") pod "global-pull-secret-syncer-x84vd" (UID: "e00077f0-0cf1-4564-8e70-03e238d3cc02") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:48.749280 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:48.749217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:48.749484 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.749465 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:44:48.749559 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.749493 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:44:48.749559 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.749506 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xqp2l for pod openshift-network-diagnostics/network-check-target-gbcw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:48.749661 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:48.749563 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l podName:37421769-7624-4dc7-8132-2b261ee2b2bc nodeName:}" failed. No retries permitted until 2026-07-23 18:44:52.749545502 +0000 UTC m=+10.211204535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqp2l" (UniqueName: "kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l") pod "network-check-target-gbcw5" (UID: "37421769-7624-4dc7-8132-2b261ee2b2bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:49.049706 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:49.049656 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:49.049861 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:49.049799 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:44:50.049949 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:50.049912 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:50.050454 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:50.050063 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:50.050528 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:50.050463 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:50.050584 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:50.050557 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:51.049182 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:51.049144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:51.049374 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:51.049301 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:44:52.050183 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:52.050103 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:52.050658 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.050228 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:52.050658 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:52.050235 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:52.050658 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.050353 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:52.583021 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:52.582438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:52.583021 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.582632 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:52.583021 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.582699 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs podName:5e889600-f076-4834-8a7b-90daf2a1fee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:45:00.582680083 +0000 UTC m=+18.044339130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs") pod "network-metrics-daemon-l9qfg" (UID: "5e889600-f076-4834-8a7b-90daf2a1fee1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:44:52.682940 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:52.682886 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:52.683095 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.683039 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:52.683133 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.683101 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret podName:e00077f0-0cf1-4564-8e70-03e238d3cc02 nodeName:}" failed. No retries permitted until 2026-07-23 18:45:00.683082734 +0000 UTC m=+18.144741769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret") pod "global-pull-secret-syncer-x84vd" (UID: "e00077f0-0cf1-4564-8e70-03e238d3cc02") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:44:52.783586 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:52.783544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:52.783769 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.783723 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:44:52.783769 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.783746 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:44:52.783769 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.783759 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xqp2l for pod openshift-network-diagnostics/network-check-target-gbcw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:52.783887 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:52.783814 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l podName:37421769-7624-4dc7-8132-2b261ee2b2bc nodeName:}" failed. No retries permitted until 2026-07-23 18:45:00.783797434 +0000 UTC m=+18.245456464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqp2l" (UniqueName: "kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l") pod "network-check-target-gbcw5" (UID: "37421769-7624-4dc7-8132-2b261ee2b2bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:44:53.051591 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:53.051067 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:53.051591 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:53.051181 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:44:54.049867 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:54.049830 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:54.050048 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:54.049986 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:54.050111 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:54.050072 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:54.050221 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:54.050171 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:55.050423 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:55.050385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:55.050819 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:55.050521 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:44:56.049151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:56.049117 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:56.049151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:56.049142 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:56.049423 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:56.049296 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:56.049423 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:56.049385 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:57.049372 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:57.049340 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:57.049819 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:57.049470 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:44:58.049644 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:58.049611 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:44:58.050113 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:58.049749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:44:58.050113 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:58.049804 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:44:58.050113 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:58.049917 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:44:59.049878 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:44:59.049845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:44:59.050303 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:44:59.049994 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:00.050129 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:00.050090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:00.050510 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:00.050109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:00.050510 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.050211 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:00.050510 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.050257 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:00.643118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:00.643074 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:00.643277 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.643231 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:45:00.643347 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.643320 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs podName:5e889600-f076-4834-8a7b-90daf2a1fee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:45:16.643298141 +0000 UTC m=+34.104957193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs") pod "network-metrics-daemon-l9qfg" (UID: "5e889600-f076-4834-8a7b-90daf2a1fee1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:45:00.743610 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:00.743564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:00.743795 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.743780 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:45:00.743849 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.743844 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret podName:e00077f0-0cf1-4564-8e70-03e238d3cc02 nodeName:}" failed. No retries permitted until 2026-07-23 18:45:16.743825804 +0000 UTC m=+34.205484852 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret") pod "global-pull-secret-syncer-x84vd" (UID: "e00077f0-0cf1-4564-8e70-03e238d3cc02") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:45:00.844774 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:00.844721 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:00.845003 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.844873 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:45:00.845003 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.844897 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:45:00.845003 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.844909 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xqp2l for pod openshift-network-diagnostics/network-check-target-gbcw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:45:00.845003 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:00.844973 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l podName:37421769-7624-4dc7-8132-2b261ee2b2bc nodeName:}" failed. No retries permitted until 2026-07-23 18:45:16.844955163 +0000 UTC m=+34.306614214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqp2l" (UniqueName: "kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l") pod "network-check-target-gbcw5" (UID: "37421769-7624-4dc7-8132-2b261ee2b2bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:45:01.049564 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:01.049476 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:01.049713 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:01.049605 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:02.049943 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:02.049901 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:02.049943 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:02.049939 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:02.050450 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:02.050053 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:02.050450 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:02.050206 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:03.050535 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:03.050496 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:03.050957 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:03.050634 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:04.049446 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:04.049415 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:04.049633 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:04.049415 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:04.049633 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:04.049549 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:04.049633 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:04.049602 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:05.049345 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.049164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:05.049718 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:05.049451 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:05.138850 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.138661 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rrgpm" event={"ID":"45f63750-cea4-431b-acfa-026bee9b3d99","Type":"ContainerStarted","Data":"9385ef78013851b5c690c2196b32b56c2bac48f8e02c177b94ce309a2e2d066e"} Jul 23 18:45:05.140411 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.140392 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:45:05.140731 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.140713 2563 generic.go:356] "Generic (PLEG): container finished" podID="034c9bbb-b208-49f1-bbe4-6d4675c43405" containerID="ea98ce0fb1193f05723d9d84cb86e493eaa2e1a03357edd801da8893cbbf1205" exitCode=1 Jul 23 18:45:05.140800 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.140773 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"194314de630afffaa70ce47a35a857175605a5a566385eed66e868ad5062005d"} Jul 23 18:45:05.140847 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.140825 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerDied","Data":"ea98ce0fb1193f05723d9d84cb86e493eaa2e1a03357edd801da8893cbbf1205"} Jul 23 18:45:05.140892 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.140855 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"437da8a29ce320e57b111c589539df3850e2289666b034d62f2a8ad87485a86d"} Jul 23 18:45:05.142037 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.142017 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tm9rb" event={"ID":"89657ad4-1c6e-4e7c-b48d-e911162cd051","Type":"ContainerStarted","Data":"ebf5ed18d331abe4f6d0bda759777fc66046bbb6b3acaebecc16f1f39343aebb"} Jul 23 18:45:05.143410 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.143382 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pkbhs" event={"ID":"25daf9d9-2730-4655-b07c-33c60cb89832","Type":"ContainerStarted","Data":"fb736e9b8b22a5fddb80d1973ecdb4001983848302cc3ee677e3206d0532b7c6"} Jul 23 18:45:05.144658 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.144639 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" event={"ID":"063ef17e-7475-41a0-97ee-23898b14a662","Type":"ContainerStarted","Data":"fc5d216d6cc00988aa262e24825aae0bcb9d58d6793e842433ef56598c1c6649"} Jul 23 18:45:05.145849 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.145825 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" event={"ID":"9eb87c8b-9085-41c3-a42e-a5f15e633aa3","Type":"ContainerStarted","Data":"d77d10aba899c3038bb98e16917df13e7393e4de70363e0b2ecae978e4715a34"} Jul 23 18:45:05.147104 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.147085 2563 generic.go:356] "Generic (PLEG): container finished" podID="aa0aad2f-f17a-417a-9c46-4d4a1efdf3da" containerID="f1c4a79ad6a2243306acdfe24059d2ad0c42a3121cb542d9276b14b4a528a3ff" exitCode=0 Jul 23 18:45:05.147198 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.147108 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerDied","Data":"f1c4a79ad6a2243306acdfe24059d2ad0c42a3121cb542d9276b14b4a528a3ff"} Jul 23 18:45:05.148461 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.148425 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jhgx6" event={"ID":"7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f","Type":"ContainerStarted","Data":"2f4f760e5086e95b5eab62b4764befe88592d980c57fb152db2c6d1a45749b35"} Jul 23 18:45:05.177418 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.177379 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" podStartSLOduration=21.17736604 podStartE2EDuration="21.17736604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:44:47.143018154 +0000 UTC m=+4.604677208" watchObservedRunningTime="2026-07-23 18:45:05.17736604 +0000 UTC m=+22.639025093" Jul 23 18:45:05.227291 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.227222 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rrgpm" podStartSLOduration=3.218711888 podStartE2EDuration="22.227205708s" totalImagesPullingTime="19.00849382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:05.200859844 +0000 UTC m=+22.662518894" watchObservedRunningTime="2026-07-23 18:45:05.227205708 +0000 UTC m=+22.688864811" Jul 23 18:45:05.227412 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.227382 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tm9rb" podStartSLOduration=3.20651544 podStartE2EDuration="22.227375865s" totalImagesPullingTime="19.020860425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:05.22695353 +0000 UTC m=+22.688612582" watchObservedRunningTime="2026-07-23 18:45:05.227375865 +0000 UTC m=+22.689034917" Jul 23 18:45:05.250093 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.250040 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pkbhs" podStartSLOduration=3.188044404 podStartE2EDuration="22.250019738s" totalImagesPullingTime="19.061975334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:05.249565999 +0000 UTC m=+22.711225050" watchObservedRunningTime="2026-07-23 18:45:05.250019738 +0000 UTC m=+22.711678793" Jul 23 18:45:05.275373 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.274710 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cf4ts" podStartSLOduration=3.239305427 podStartE2EDuration="22.274691508s" totalImagesPullingTime="19.035386081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:05.273973783 +0000 UTC m=+22.735632834" watchObservedRunningTime="2026-07-23 18:45:05.274691508 +0000 UTC m=+22.736350560" Jul 23 18:45:05.428129 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.428094 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:05.506539 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.506448 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:05.815391 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.815368 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 18:45:05.971030 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.970940 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:45:05.815385071Z","UUID":"53e47364-d986-42db-a228-3a1d7be55c51","Handler":null,"Name":"","Endpoint":""} Jul 23 18:45:05.972355 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.972337 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 18:45:05.972427 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.972378 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 18:45:05.983247 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:05.983218 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:06.049415 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.049330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:06.049915 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.049330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:06.049915 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:06.049779 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:06.050025 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:06.049913 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:06.119491 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.119451 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:06.152758 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.152721 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" event={"ID":"063ef17e-7475-41a0-97ee-23898b14a662","Type":"ContainerStarted","Data":"0a148539212d7e97d4eef307cd6357adaedd6ae92d22395804079efb11fd3953"} Jul 23 18:45:06.155394 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.155374 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:45:06.155762 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.155744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"9c1aad0de40905c1df7170613f605409752ed9c9a42a5c69eda1f05498840785"} Jul 23 18:45:06.155833 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.155803 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"32e8a97d17c0024fa01fefe47a571d3284df4998797657c909f4150bc525c72e"} Jul 23 18:45:06.155880 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.155843 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"6cd6b8ce58917b335616293a3924506077a3ae6556ccca3e465f8cfbe77ec308"} Jul 23 18:45:06.157148 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.157124 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k76kq" event={"ID":"a4958947-fc82-4833-bbf8-212b3ff010bb","Type":"ContainerStarted","Data":"7bd7909ba01b252b67e93836867791c5ee9c668567cc5ee4df995beb6b63be89"} Jul 23 18:45:06.173787 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.173741 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jhgx6" podStartSLOduration=4.134653259 podStartE2EDuration="23.173722293s" totalImagesPullingTime="19.039069034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:05.300990303 +0000 UTC m=+22.762649353" watchObservedRunningTime="2026-07-23 18:45:06.173722293 +0000 UTC m=+23.635381339" Jul 23 18:45:06.174008 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.173984 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k76kq" podStartSLOduration=4.135143435 podStartE2EDuration="23.173974358s" totalImagesPullingTime="19.038830923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:06.173690274 +0000 UTC m=+23.635349324" watchObservedRunningTime="2026-07-23 18:45:06.173974358 +0000 UTC m=+23.635633410" Jul 23 18:45:06.201529 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.201499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:06.328330 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.328240 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:06.414317 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.414258 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:06.634457 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.634422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:06.733479 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:06.733448 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:07.050340 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:07.050248 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:07.050748 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:07.050400 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:07.173703 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:07.173677 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jhgx6_7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f/dns-node-resolver/0.log" Jul 23 18:45:07.354322 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:07.354220 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:07.432703 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:07.432671 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:45:07.433299 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:07.433253 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:45:07.460751 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:07.460726 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:08.049458 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.049430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:08.049652 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.049430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:08.049732 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:08.049604 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:08.049789 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:08.049739 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:08.165611 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.165576 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:45:08.166062 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.166040 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"c1c8e73c543c943b6fe622474ae2576520a9ff2a836bc9cac578332275919390"} Jul 23 18:45:08.168464 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.168428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" event={"ID":"063ef17e-7475-41a0-97ee-23898b14a662","Type":"ContainerStarted","Data":"29a531e747f4f484af2f423cfb75e04011fe10b8a7f6d59dde93d4a6f345faf8"} Jul 23 18:45:08.168788 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.168734 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:45:08.169243 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.169217 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rrgpm" Jul 23 18:45:08.192961 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.192933 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tm9rb_89657ad4-1c6e-4e7c-b48d-e911162cd051/node-ca/0.log" Jul 23 18:45:08.232314 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:08.232237 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dqw7d" podStartSLOduration=3.936181098 podStartE2EDuration="25.232217143s" totalImagesPullingTime="21.296036045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:08.231717577 +0000 UTC m=+25.693376630" watchObservedRunningTime="2026-07-23 18:45:08.232217143 +0000 UTC m=+25.693876195" Jul 23 18:45:09.006495 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.006214 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:09.049698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.049666 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:09.049849 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:09.049775 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:09.141021 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.140987 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:09.228399 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.228350 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:09.349210 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.349132 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:09.454067 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.454023 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:09.550531 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.550498 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:09.815479 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:09.815449 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:10.050173 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:10.050139 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:10.050369 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:10.050188 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:10.050369 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:10.050254 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:10.050500 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:10.050395 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:10.457446 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:10.457408 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:10.669424 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:10.669165 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:10.797685 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:10.797514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:11.052175 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.052084 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:11.052175 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:11.052170 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:11.176492 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.176462 2563 generic.go:356] "Generic (PLEG): container finished" podID="aa0aad2f-f17a-417a-9c46-4d4a1efdf3da" containerID="1fb63835ae6c326db6cd0d4075fa1b06a9278cbfc887a3f99608f8e4446a7d2d" exitCode=0 Jul 23 18:45:11.176665 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.176543 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerDied","Data":"1fb63835ae6c326db6cd0d4075fa1b06a9278cbfc887a3f99608f8e4446a7d2d"} Jul 23 18:45:11.180170 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.180147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:45:11.180533 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.180506 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"68719186e3b4e93ec0f714042dc849807b4d9f2a3e4867514c8d501e25c12f07"} Jul 23 18:45:11.180769 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.180754 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:45:11.180919 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.180902 2563 scope.go:117] "RemoveContainer" containerID="ea98ce0fb1193f05723d9d84cb86e493eaa2e1a03357edd801da8893cbbf1205" Jul 23 18:45:11.197888 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.197862 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:45:11.235215 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:11.235187 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:12.049861 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.049822 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:12.050595 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:12.049942 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:12.050595 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.049996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:12.050595 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:12.050132 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:12.149898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.149865 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:12.187408 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.187384 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:45:12.187822 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.187792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" event={"ID":"034c9bbb-b208-49f1-bbe4-6d4675c43405","Type":"ContainerStarted","Data":"cd657543e4cc1aa7a23a51be013d1ec9e8a777ea826c2f4c257815b2180a6c2c"} Jul 23 18:45:12.188056 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.188036 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:45:12.188151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.188107 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:45:12.190305 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.190254 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerStarted","Data":"9331428a597d6f5bac0db5875bc3634d33a8e691485a64571287c682836ea361"} Jul 23 18:45:12.206827 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.206800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:45:12.222416 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.222371 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" podStartSLOduration=9.954662217 podStartE2EDuration="29.222354594s" totalImagesPullingTime="19.267692377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:12.222130646 +0000 UTC m=+29.683789718" watchObservedRunningTime="2026-07-23 18:45:12.222354594 +0000 UTC m=+29.684013646" Jul 23 18:45:12.534456 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.534425 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:12.733043 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.733007 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:12.946935 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:12.946902 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:13.050587 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:13.050555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:13.050927 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:13.050639 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:13.194670 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:13.194637 2563 generic.go:356] "Generic (PLEG): container finished" podID="aa0aad2f-f17a-417a-9c46-4d4a1efdf3da" containerID="9331428a597d6f5bac0db5875bc3634d33a8e691485a64571287c682836ea361" exitCode=0 Jul 23 18:45:13.194800 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:13.194709 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerDied","Data":"9331428a597d6f5bac0db5875bc3634d33a8e691485a64571287c682836ea361"} Jul 23 18:45:13.340048 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:13.340011 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:13.739552 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:13.739523 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:14.049925 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.049907 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:14.050017 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:14.050003 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:14.050080 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.050066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:14.050216 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:14.050178 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:14.060540 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.060515 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:14.199856 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.199827 2563 generic.go:356] "Generic (PLEG): container finished" podID="aa0aad2f-f17a-417a-9c46-4d4a1efdf3da" containerID="6b7c6290d51b363369f45b7be35a74376d3cc31a342bc41010654f8ad7e44dea" exitCode=0 Jul 23 18:45:14.200022 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.199904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerDied","Data":"6b7c6290d51b363369f45b7be35a74376d3cc31a342bc41010654f8ad7e44dea"} Jul 23 18:45:14.535014 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.534982 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:14.647932 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.647894 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:14.766695 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:14.766657 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:15.049914 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:15.049883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:15.050081 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:15.050001 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:15.170736 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:15.170695 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:15.272171 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:15.272121 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:15.554943 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:15.554904 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:15.934501 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:15.934457 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:16.049367 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.049330 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:16.049660 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.049373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:16.049660 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.049447 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:16.049660 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.049583 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:16.334058 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.333959 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:16.537715 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.537677 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:16.659171 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.659136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:16.659379 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.659308 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:45:16.659447 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.659380 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs podName:5e889600-f076-4834-8a7b-90daf2a1fee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:45:48.659362305 +0000 UTC m=+66.121021334 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs") pod "network-metrics-daemon-l9qfg" (UID: "5e889600-f076-4834-8a7b-90daf2a1fee1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:45:16.701780 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.701737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:16.760025 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.759983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:16.760200 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.760134 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:45:16.760249 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.760202 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret podName:e00077f0-0cf1-4564-8e70-03e238d3cc02 nodeName:}" failed. No retries permitted until 2026-07-23 18:45:48.760187588 +0000 UTC m=+66.221846616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret") pod "global-pull-secret-syncer-x84vd" (UID: "e00077f0-0cf1-4564-8e70-03e238d3cc02") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:45:16.861439 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.861405 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:16.861673 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.861611 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:45:16.861673 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.861640 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:45:16.861673 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.861654 2563 projected.go:196] Error preparing data for projected volume kube-api-access-xqp2l for pod openshift-network-diagnostics/network-check-target-gbcw5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:45:16.861891 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:16.861721 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l podName:37421769-7624-4dc7-8132-2b261ee2b2bc nodeName:}" failed. No retries permitted until 2026-07-23 18:45:48.861702154 +0000 UTC m=+66.323361198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xqp2l" (UniqueName: "kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l") pod "network-check-target-gbcw5" (UID: "37421769-7624-4dc7-8132-2b261ee2b2bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:45:16.935720 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:16.935637 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:17.049386 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:17.049354 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:17.049570 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:17.049487 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:17.577660 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:17.577626 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:18.049677 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:18.049630 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:18.049677 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:18.049662 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:18.049915 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:18.049777 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:18.049973 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:18.049911 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:18.168776 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:18.168742 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:18.356214 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:18.356068 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:18.774190 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:18.774156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:18.957509 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:18.957417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:19.049827 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:19.049793 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:19.049990 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:19.049917 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:19.214588 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:19.214509 2563 generic.go:356] "Generic (PLEG): container finished" podID="aa0aad2f-f17a-417a-9c46-4d4a1efdf3da" containerID="1d9b3f8f44ef42208229d7d97f6a22315705797b9f523740faf1330c17a1c43c" exitCode=0 Jul 23 18:45:19.214720 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:19.214584 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerDied","Data":"1d9b3f8f44ef42208229d7d97f6a22315705797b9f523740faf1330c17a1c43c"} Jul 23 18:45:19.540703 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:19.540606 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:19.943910 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:19.943876 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:20.049388 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:20.049348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:20.049388 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:20.049380 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:20.049585 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:20.049481 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:20.049624 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:20.049591 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:20.220033 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:20.219956 2563 generic.go:356] "Generic (PLEG): container finished" podID="aa0aad2f-f17a-417a-9c46-4d4a1efdf3da" containerID="17595a1094704052ccc20311d4ee6ea026b195cedce6c602a07d8323ef222220" exitCode=0 Jul 23 18:45:20.220033 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:20.220022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerDied","Data":"17595a1094704052ccc20311d4ee6ea026b195cedce6c602a07d8323ef222220"} Jul 23 18:45:20.339157 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:20.339129 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:20.545701 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:20.545610 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:20.941671 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:20.941639 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:21.049502 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:21.049473 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:21.049869 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:21.049612 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:21.225220 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:21.225130 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" event={"ID":"aa0aad2f-f17a-417a-9c46-4d4a1efdf3da","Type":"ContainerStarted","Data":"a0018e683a913fd5cf8600eb29b4b01bd02d1cc5981175a7bf7b9666791cc416"} Jul 23 18:45:21.274561 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:21.274515 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dbvr5" podStartSLOduration=7.596711614 podStartE2EDuration="38.274495987s" totalImagesPullingTime="30.677784373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:21.273311327 +0000 UTC m=+38.734970382" watchObservedRunningTime="2026-07-23 18:45:21.274495987 +0000 UTC m=+38.736155034" Jul 23 18:45:21.378925 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:21.378896 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:21.834750 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:21.834719 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:22.050137 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:22.050100 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:22.050598 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:22.050209 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:22.050598 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:22.050238 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:22.050598 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:22.050310 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:23.050719 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:23.050685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:23.051195 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:23.050768 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:23.202519 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:23.202483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:23.329400 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:23.329305 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:23.720656 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:23.720622 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:23.823378 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:23.823345 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:23.923069 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:23.923036 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:24.016905 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:24.016812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:24.049928 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:24.049895 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:24.049928 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:24.049919 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:24.050153 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:24.050020 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:24.050153 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:24.050107 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:24.167816 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:24.167759 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:24.285310 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:24.285021 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:24.381088 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:24.381054 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:25.049534 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:25.049493 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:25.049717 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:25.049617 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:25.370795 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:25.370699 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:25.593151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:25.593112 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:25.720655 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:25.720624 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:25.831290 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:25.831237 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:26.026254 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:26.026175 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:26.049347 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:26.049320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:26.049347 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:26.049343 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:26.049501 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:26.049427 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:26.049561 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:26.049544 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:27.049524 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:27.049487 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:27.049916 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:27.049595 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:28.049803 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:28.049766 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:28.050205 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:28.049768 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:28.050205 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:28.049872 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:28.050205 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:28.049946 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:29.049378 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:29.049347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:29.049552 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:29.049451 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:30.049438 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:30.049403 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:30.049791 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:30.049502 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:30.049791 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:30.049557 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:30.049791 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:30.049647 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:31.049233 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:31.049201 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:31.049448 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:31.049342 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:31.365016 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:31.364923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:31.571669 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:31.571639 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:31.911226 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:31.911185 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:32.049901 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:32.049872 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:32.049901 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:32.049884 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:32.050114 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:32.049996 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:32.050150 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:32.050132 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:32.106077 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:32.106047 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:32.325978 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:32.325902 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:32.502354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:32.502318 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:33.050255 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.050229 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:33.050468 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:33.050332 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:33.404921 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.404884 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x84vd"] Jul 23 18:45:33.405104 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.404988 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:33.405104 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:33.405066 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:33.412463 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.412435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbcw5"] Jul 23 18:45:33.412598 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.412519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:33.412598 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:33.412591 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:33.416055 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.416028 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9qfg"] Jul 23 18:45:33.416165 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.416117 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:33.416211 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:33.416188 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:33.709307 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.709208 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:33.821710 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:33.821680 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:35.049288 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:35.049176 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:35.049288 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:35.049208 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:35.049855 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:35.049306 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:35.049855 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:35.049317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:35.049855 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:35.049393 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:35.049855 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:35.049446 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:37.049824 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.049791 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:37.050294 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.049791 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:37.050294 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:37.049888 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x84vd" podUID="e00077f0-0cf1-4564-8e70-03e238d3cc02" Jul 23 18:45:37.050294 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.049914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:37.050294 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:37.050036 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9qfg" podUID="5e889600-f076-4834-8a7b-90daf2a1fee1" Jul 23 18:45:37.050294 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:45:37.050144 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gbcw5" podUID="37421769-7624-4dc7-8132-2b261ee2b2bc" Jul 23 18:45:37.352633 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.352542 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeReady" Jul 23 18:45:37.352785 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.352714 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 18:45:37.542305 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.542249 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gx9s7"] Jul 23 18:45:37.556022 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.555996 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d5x2m"] Jul 23 18:45:37.556150 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.556113 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.560529 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.560499 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 18:45:37.560674 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.560656 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 18:45:37.560739 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.560715 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7zq6f\"" Jul 23 18:45:37.560739 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.560730 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 18:45:37.566395 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.566373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.570334 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.570319 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 18:45:37.570525 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.570483 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 18:45:37.575256 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.575239 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-66gzj\"" Jul 23 18:45:37.589894 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.589872 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx9s7"] Jul 23 18:45:37.595487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.595464 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n9c4f"] Jul 23 18:45:37.603085 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.603032 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d5x2m"] Jul 23 18:45:37.603180 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.603141 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.609044 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.609012 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 18:45:37.609173 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.609138 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 18:45:37.610509 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610490 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 18:45:37.610590 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6752b02-c2f6-4e21-9684-ca39f89ebccd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.610590 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610549 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nfrtz\"" Jul 23 18:45:37.610705 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610591 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d46ce75-2e0c-4aec-b65d-928b732e3388-config-volume\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.610705 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610632 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6752b02-c2f6-4e21-9684-ca39f89ebccd-crio-socket\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.610705 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6752b02-c2f6-4e21-9684-ca39f89ebccd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.610705 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnkj4\" (UniqueName: \"kubernetes.io/projected/0d46ce75-2e0c-4aec-b65d-928b732e3388-kube-api-access-tnkj4\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.610846 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610767 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d46ce75-2e0c-4aec-b65d-928b732e3388-tmp-dir\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.610846 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6752b02-c2f6-4e21-9684-ca39f89ebccd-data-volume\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.610846 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610824 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbcp9\" (UniqueName: \"kubernetes.io/projected/f6752b02-c2f6-4e21-9684-ca39f89ebccd-kube-api-access-gbcp9\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.610939 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610851 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce92595-1253-445a-8342-4b596317c73f-cert\") pod \"ingress-canary-gx9s7\" (UID: \"2ce92595-1253-445a-8342-4b596317c73f\") " pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.610939 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610872 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8j6n\" (UniqueName: \"kubernetes.io/projected/2ce92595-1253-445a-8342-4b596317c73f-kube-api-access-b8j6n\") pod \"ingress-canary-gx9s7\" (UID: \"2ce92595-1253-445a-8342-4b596317c73f\") " pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.610939 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.610904 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d46ce75-2e0c-4aec-b65d-928b732e3388-metrics-tls\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.615714 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.615702 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 18:45:37.628333 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.628306 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n9c4f"] Jul 23 18:45:37.657617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.657577 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:37.711792 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.711763 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnkj4\" (UniqueName: \"kubernetes.io/projected/0d46ce75-2e0c-4aec-b65d-928b732e3388-kube-api-access-tnkj4\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.711986 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.711810 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d46ce75-2e0c-4aec-b65d-928b732e3388-tmp-dir\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.711986 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.711830 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6752b02-c2f6-4e21-9684-ca39f89ebccd-data-volume\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.711986 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.711849 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbcp9\" (UniqueName: \"kubernetes.io/projected/f6752b02-c2f6-4e21-9684-ca39f89ebccd-kube-api-access-gbcp9\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.712141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.711980 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce92595-1253-445a-8342-4b596317c73f-cert\") pod \"ingress-canary-gx9s7\" (UID: \"2ce92595-1253-445a-8342-4b596317c73f\") " pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.712141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8j6n\" (UniqueName: \"kubernetes.io/projected/2ce92595-1253-445a-8342-4b596317c73f-kube-api-access-b8j6n\") pod \"ingress-canary-gx9s7\" (UID: \"2ce92595-1253-445a-8342-4b596317c73f\") " pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.712141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712113 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d46ce75-2e0c-4aec-b65d-928b732e3388-tmp-dir\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.712141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712135 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d46ce75-2e0c-4aec-b65d-928b732e3388-metrics-tls\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.712351 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712239 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f6752b02-c2f6-4e21-9684-ca39f89ebccd-data-volume\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.712351 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6752b02-c2f6-4e21-9684-ca39f89ebccd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.712351 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712302 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d46ce75-2e0c-4aec-b65d-928b732e3388-config-volume\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.712351 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712340 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6752b02-c2f6-4e21-9684-ca39f89ebccd-crio-socket\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.712552 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6752b02-c2f6-4e21-9684-ca39f89ebccd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.712671 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712447 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f6752b02-c2f6-4e21-9684-ca39f89ebccd-crio-socket\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.712853 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0d46ce75-2e0c-4aec-b65d-928b732e3388-config-volume\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.712903 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.712878 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f6752b02-c2f6-4e21-9684-ca39f89ebccd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.716181 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.716152 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d46ce75-2e0c-4aec-b65d-928b732e3388-metrics-tls\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.716181 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.716175 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f6752b02-c2f6-4e21-9684-ca39f89ebccd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.716437 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.716410 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ce92595-1253-445a-8342-4b596317c73f-cert\") pod \"ingress-canary-gx9s7\" (UID: \"2ce92595-1253-445a-8342-4b596317c73f\") " pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.722994 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.722970 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnkj4\" (UniqueName: \"kubernetes.io/projected/0d46ce75-2e0c-4aec-b65d-928b732e3388-kube-api-access-tnkj4\") pod \"dns-default-d5x2m\" (UID: \"0d46ce75-2e0c-4aec-b65d-928b732e3388\") " pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.731165 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.731141 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8j6n\" (UniqueName: \"kubernetes.io/projected/2ce92595-1253-445a-8342-4b596317c73f-kube-api-access-b8j6n\") pod \"ingress-canary-gx9s7\" (UID: \"2ce92595-1253-445a-8342-4b596317c73f\") " pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.732882 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.732862 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbcp9\" (UniqueName: \"kubernetes.io/projected/f6752b02-c2f6-4e21-9684-ca39f89ebccd-kube-api-access-gbcp9\") pod \"insights-runtime-extractor-n9c4f\" (UID: \"f6752b02-c2f6-4e21-9684-ca39f89ebccd\") " pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.803681 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.803639 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:37.864759 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.864678 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gx9s7" Jul 23 18:45:37.874391 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.874370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:37.912794 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.912654 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n9c4f" Jul 23 18:45:37.939691 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:37.937699 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:38.030372 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:38.030341 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d5x2m"] Jul 23 18:45:38.033341 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:38.033317 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gx9s7"] Jul 23 18:45:38.035711 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:38.035679 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d46ce75_2e0c_4aec_b65d_928b732e3388.slice/crio-a3b28a9587a61fec4ed0132cc40aa1c6d69cbc9b18970145c63cdf3637339f26 WatchSource:0}: Error finding container a3b28a9587a61fec4ed0132cc40aa1c6d69cbc9b18970145c63cdf3637339f26: Status 404 returned error can't find the container with id a3b28a9587a61fec4ed0132cc40aa1c6d69cbc9b18970145c63cdf3637339f26 Jul 23 18:45:38.037121 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:38.037095 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce92595_1253_445a_8342_4b596317c73f.slice/crio-acf7426691e3622641c66d99ce2eeed7233a16f434871db2962501510a8ce377 WatchSource:0}: Error finding container acf7426691e3622641c66d99ce2eeed7233a16f434871db2962501510a8ce377: Status 404 returned error can't find the container with id acf7426691e3622641c66d99ce2eeed7233a16f434871db2962501510a8ce377 Jul 23 18:45:38.084784 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:38.084748 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n9c4f"] Jul 23 18:45:38.090324 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:38.090295 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6752b02_c2f6_4e21_9684_ca39f89ebccd.slice/crio-f79da90b9aa6cc20bda970dcdb8efd70be474a5944475f5b6d7cbd1f7fe567eb WatchSource:0}: Error finding container f79da90b9aa6cc20bda970dcdb8efd70be474a5944475f5b6d7cbd1f7fe567eb: Status 404 returned error can't find the container with id f79da90b9aa6cc20bda970dcdb8efd70be474a5944475f5b6d7cbd1f7fe567eb Jul 23 18:45:38.264962 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:38.264921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5x2m" event={"ID":"0d46ce75-2e0c-4aec-b65d-928b732e3388","Type":"ContainerStarted","Data":"a3b28a9587a61fec4ed0132cc40aa1c6d69cbc9b18970145c63cdf3637339f26"} Jul 23 18:45:38.266028 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:38.265997 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx9s7" event={"ID":"2ce92595-1253-445a-8342-4b596317c73f","Type":"ContainerStarted","Data":"acf7426691e3622641c66d99ce2eeed7233a16f434871db2962501510a8ce377"} Jul 23 18:45:38.267015 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:38.266992 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9c4f" event={"ID":"f6752b02-c2f6-4e21-9684-ca39f89ebccd","Type":"ContainerStarted","Data":"f79da90b9aa6cc20bda970dcdb8efd70be474a5944475f5b6d7cbd1f7fe567eb"} Jul 23 18:45:39.052234 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.052200 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:39.053176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.052653 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:39.053176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.053109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:39.056926 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.056725 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:45:39.059724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.058190 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:45:39.059724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.058430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trr8l\"" Jul 23 18:45:39.059724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.058711 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:45:39.059724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.058881 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65vzf\"" Jul 23 18:45:39.059724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.059060 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:45:39.601841 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.601808 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:39.667005 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.666034 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78b947bcdf-vp6lf"] Jul 23 18:45:39.670598 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.668154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.673787 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.673147 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fqmjp\"" Jul 23 18:45:39.675764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.674849 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 18:45:39.675764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.675103 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 18:45:39.675764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.675327 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 18:45:39.675764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.675361 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 18:45:39.675764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.675599 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 18:45:39.681695 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.677724 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 18:45:39.681695 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.677966 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 18:45:39.691019 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.690976 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b947bcdf-vp6lf"] Jul 23 18:45:39.728991 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.728956 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjkq\" (UniqueName: \"kubernetes.io/projected/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-kube-api-access-5xjkq\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.729176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.729031 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-oauth-config\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.729176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.729060 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-oauth-serving-cert\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.729176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.729087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-serving-cert\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.729176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.729129 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-config\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.729176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.729153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-service-ca\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.734945 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.734873 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:39.829781 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.829742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjkq\" (UniqueName: \"kubernetes.io/projected/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-kube-api-access-5xjkq\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.830029 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.829820 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-oauth-config\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.830029 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.829846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-oauth-serving-cert\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.830029 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.829878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-serving-cert\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.830029 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.829921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-config\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.830029 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.829944 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-service-ca\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.831983 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.830816 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-service-ca\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.832822 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.832351 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-oauth-serving-cert\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.832822 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.832780 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-config\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.837074 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.837024 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-serving-cert\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.837630 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.837589 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-oauth-config\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.840938 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.840891 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjkq\" (UniqueName: \"kubernetes.io/projected/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-kube-api-access-5xjkq\") pod \"console-78b947bcdf-vp6lf\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:39.986055 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:39.985913 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:40.332941 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:40.332905 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78b947bcdf-vp6lf"] Jul 23 18:45:41.095017 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:41.094983 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda40e170_a23d_4a22_8c68_2b15ecc0bc1b.slice/crio-238695bc7892d9af766df22ef95c2e440e0f326d8d17589132146ccd15030757 WatchSource:0}: Error finding container 238695bc7892d9af766df22ef95c2e440e0f326d8d17589132146ccd15030757: Status 404 returned error can't find the container with id 238695bc7892d9af766df22ef95c2e440e0f326d8d17589132146ccd15030757 Jul 23 18:45:41.204208 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.204181 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:41.281542 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.281503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gx9s7" event={"ID":"2ce92595-1253-445a-8342-4b596317c73f","Type":"ContainerStarted","Data":"3670ee062fd8579a8ab10d4647ff5a5fe93297b4f9b9acd452e4e3ddfa16a440"} Jul 23 18:45:41.283075 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.283051 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b947bcdf-vp6lf" event={"ID":"da40e170-a23d-4a22-8c68-2b15ecc0bc1b","Type":"ContainerStarted","Data":"238695bc7892d9af766df22ef95c2e440e0f326d8d17589132146ccd15030757"} Jul 23 18:45:41.284681 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.284656 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5x2m" event={"ID":"0d46ce75-2e0c-4aec-b65d-928b732e3388","Type":"ContainerStarted","Data":"5892565e18781b344653cb210e1810e5fad8c57394e2b515f1b91649f11f4305"} Jul 23 18:45:41.284784 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.284693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d5x2m" event={"ID":"0d46ce75-2e0c-4aec-b65d-928b732e3388","Type":"ContainerStarted","Data":"5454835536a355dd8aba43f02f60d3e810c8da1100f5e43635f4b0326a15fb56"} Jul 23 18:45:41.285109 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.285057 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:41.335132 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.334932 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gx9s7" podStartSLOduration=1.244240408 podStartE2EDuration="4.334915558s" totalImagesPullingTime="3.09067515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:41.304762886 +0000 UTC m=+58.766421940" watchObservedRunningTime="2026-07-23 18:45:41.334915558 +0000 UTC m=+58.796574651" Jul 23 18:45:41.335585 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.335549 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d5x2m" podStartSLOduration=2.224704426 podStartE2EDuration="4.335537313s" totalImagesPullingTime="2.110832887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:41.334745718 +0000 UTC m=+58.796404771" watchObservedRunningTime="2026-07-23 18:45:41.335537313 +0000 UTC m=+58.797196363" Jul 23 18:45:41.523595 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.523465 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:41.762192 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:41.762160 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:43.197708 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:43.197678 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:43.299470 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:43.299433 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:44.214232 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:44.214204 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-26p9d" Jul 23 18:45:44.296522 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:44.296488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9c4f" event={"ID":"f6752b02-c2f6-4e21-9684-ca39f89ebccd","Type":"ContainerStarted","Data":"be8e2057d2943a26bdaf074733ee4c59f63bd46788a36fb95d58fc51e532e375"} Jul 23 18:45:44.415153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:44.415110 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:44.522087 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:44.522051 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:44.779477 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:44.779392 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:44.884927 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:44.884891 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:45.512689 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.512652 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:45.631236 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.631203 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:45.741512 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.741407 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:45.784106 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.784034 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6"] Jul 23 18:45:45.788131 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.788105 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" Jul 23 18:45:45.793017 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.792991 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 18:45:45.793156 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.793061 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-b9mxf\"" Jul 23 18:45:45.810187 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.810151 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6"] Jul 23 18:45:45.831058 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.831024 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74cd4466df-tz8n6"] Jul 23 18:45:45.836242 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.835914 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.848532 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.848466 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74cd4466df-tz8n6"] Jul 23 18:45:45.861661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.861585 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 18:45:45.881939 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.881905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f59b3e8a-d1c0-469f-935e-d7c9110c7b9d-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xx5t6\" (UID: \"f59b3e8a-d1c0-469f-935e-d7c9110c7b9d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" Jul 23 18:45:45.882121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.881962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-trusted-ca-bundle\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.882121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.882087 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-config\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.882121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.882112 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2mj6\" (UniqueName: \"kubernetes.io/projected/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-kube-api-access-f2mj6\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.882302 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.882134 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-oauth-serving-cert\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.882302 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.882168 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-serving-cert\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.882302 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.882192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-oauth-config\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.882302 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.882216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-service-ca\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.894952 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.894915 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:45.983430 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983396 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-oauth-serving-cert\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.983602 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-serving-cert\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.983602 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983576 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-oauth-config\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.983710 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-service-ca\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.983710 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983661 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f59b3e8a-d1c0-469f-935e-d7c9110c7b9d-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xx5t6\" (UID: \"f59b3e8a-d1c0-469f-935e-d7c9110c7b9d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" Jul 23 18:45:45.983806 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-trusted-ca-bundle\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.983806 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-config\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.983911 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.983819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2mj6\" (UniqueName: \"kubernetes.io/projected/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-kube-api-access-f2mj6\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.984440 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.984255 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-oauth-serving-cert\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.984854 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.984795 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-config\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.985034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.984928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-trusted-ca-bundle\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.985034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.984977 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-service-ca\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.986533 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.986504 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-oauth-config\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.986703 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.986687 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-serving-cert\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:45.986845 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.986828 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f59b3e8a-d1c0-469f-935e-d7c9110c7b9d-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-xx5t6\" (UID: \"f59b3e8a-d1c0-469f-935e-d7c9110c7b9d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" Jul 23 18:45:45.988129 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.988099 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:45.993484 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:45.993462 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2mj6\" (UniqueName: \"kubernetes.io/projected/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-kube-api-access-f2mj6\") pod \"console-74cd4466df-tz8n6\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:46.089918 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:46.089846 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:46.097719 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:46.097682 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" Jul 23 18:45:46.146530 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:46.146491 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:46.191517 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:46.191480 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:46.807378 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:46.807237 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:46.908851 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:46.908802 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:47.396808 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:47.396774 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:47.492697 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:47.492658 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:48.310320 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.310280 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9c4f" event={"ID":"f6752b02-c2f6-4e21-9684-ca39f89ebccd","Type":"ContainerStarted","Data":"9dc1d32229bcceed396cef3bff1f409d19a75d7a4e03cfc406637529b09d3c21"} Jul 23 18:45:48.312241 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.312177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b947bcdf-vp6lf" event={"ID":"da40e170-a23d-4a22-8c68-2b15ecc0bc1b","Type":"ContainerStarted","Data":"467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4"} Jul 23 18:45:48.325367 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.325261 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74cd4466df-tz8n6"] Jul 23 18:45:48.329399 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:48.329373 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4930d2e4_c74e_40c0_9b10_22bbf4c261c7.slice/crio-4a0c847d0d8e21cf08ee4d18be36a5daec3b26b21d4137351995fab453efaf5d WatchSource:0}: Error finding container 4a0c847d0d8e21cf08ee4d18be36a5daec3b26b21d4137351995fab453efaf5d: Status 404 returned error can't find the container with id 4a0c847d0d8e21cf08ee4d18be36a5daec3b26b21d4137351995fab453efaf5d Jul 23 18:45:48.347879 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.347834 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78b947bcdf-vp6lf" podStartSLOduration=2.271772489 podStartE2EDuration="9.3478174s" totalImagesPullingTime="7.076044911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:48.346703303 +0000 UTC m=+65.808362347" watchObservedRunningTime="2026-07-23 18:45:48.3478174 +0000 UTC m=+65.809476450" Jul 23 18:45:48.368948 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.368796 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6"] Jul 23 18:45:48.373500 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:48.373467 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf59b3e8a_d1c0_469f_935e_d7c9110c7b9d.slice/crio-0448febf27865cb486a7bc54152805d8e0ca56ed9f89151cbf5ade87799b60ad WatchSource:0}: Error finding container 0448febf27865cb486a7bc54152805d8e0ca56ed9f89151cbf5ade87799b60ad: Status 404 returned error can't find the container with id 0448febf27865cb486a7bc54152805d8e0ca56ed9f89151cbf5ade87799b60ad Jul 23 18:45:48.641580 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.641550 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:48.705358 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.705320 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:48.709005 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.708983 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:45:48.718152 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.718127 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e889600-f076-4834-8a7b-90daf2a1fee1-metrics-certs\") pod \"network-metrics-daemon-l9qfg\" (UID: \"5e889600-f076-4834-8a7b-90daf2a1fee1\") " pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:48.740937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.740847 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:48.805886 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.805852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:48.808810 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.808772 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:45:48.818635 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.818611 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e00077f0-0cf1-4564-8e70-03e238d3cc02-original-pull-secret\") pod \"global-pull-secret-syncer-x84vd\" (UID: \"e00077f0-0cf1-4564-8e70-03e238d3cc02\") " pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:48.841769 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.841737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:48.906402 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.906278 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:48.909161 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.909133 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:45:48.919409 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.919383 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:45:48.929662 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.929633 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqp2l\" (UniqueName: \"kubernetes.io/projected/37421769-7624-4dc7-8132-2b261ee2b2bc-kube-api-access-xqp2l\") pod \"network-check-target-gbcw5\" (UID: \"37421769-7624-4dc7-8132-2b261ee2b2bc\") " pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:48.971410 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.971373 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x84vd" Jul 23 18:45:48.986208 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.986181 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-trr8l\"" Jul 23 18:45:48.993717 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.993679 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:48.997078 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:48.997056 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-65vzf\"" Jul 23 18:45:49.000884 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.000855 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9qfg" Jul 23 18:45:49.159498 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.159371 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x84vd"] Jul 23 18:45:49.163601 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:49.163572 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00077f0_0cf1_4564_8e70_03e238d3cc02.slice/crio-8816ad813f8c26a21e35da04e0cdad8b816eae7fdb33c06b60bae6490b3fa82e WatchSource:0}: Error finding container 8816ad813f8c26a21e35da04e0cdad8b816eae7fdb33c06b60bae6490b3fa82e: Status 404 returned error can't find the container with id 8816ad813f8c26a21e35da04e0cdad8b816eae7fdb33c06b60bae6490b3fa82e Jul 23 18:45:49.208498 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.208450 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gbcw5"] Jul 23 18:45:49.222284 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:49.222235 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37421769_7624_4dc7_8132_2b261ee2b2bc.slice/crio-832f7af0be7b7190069565d4e8fb5ed29153273ecfc7904d6a0185b50d43b20d WatchSource:0}: Error finding container 832f7af0be7b7190069565d4e8fb5ed29153273ecfc7904d6a0185b50d43b20d: Status 404 returned error can't find the container with id 832f7af0be7b7190069565d4e8fb5ed29153273ecfc7904d6a0185b50d43b20d Jul 23 18:45:49.241695 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.241617 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9qfg"] Jul 23 18:45:49.245587 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:45:49.245560 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e889600_f076_4834_8a7b_90daf2a1fee1.slice/crio-89385df7d13dd27c5f32fc16619bfdaf4d7846740a0f0f561af5391f2ddfdd1a WatchSource:0}: Error finding container 89385df7d13dd27c5f32fc16619bfdaf4d7846740a0f0f561af5391f2ddfdd1a: Status 404 returned error can't find the container with id 89385df7d13dd27c5f32fc16619bfdaf4d7846740a0f0f561af5391f2ddfdd1a Jul 23 18:45:49.284305 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.284253 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:49.317729 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.317693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9qfg" event={"ID":"5e889600-f076-4834-8a7b-90daf2a1fee1","Type":"ContainerStarted","Data":"89385df7d13dd27c5f32fc16619bfdaf4d7846740a0f0f561af5391f2ddfdd1a"} Jul 23 18:45:49.319019 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.318983 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" event={"ID":"f59b3e8a-d1c0-469f-935e-d7c9110c7b9d","Type":"ContainerStarted","Data":"0448febf27865cb486a7bc54152805d8e0ca56ed9f89151cbf5ade87799b60ad"} Jul 23 18:45:49.320920 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.320883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd4466df-tz8n6" event={"ID":"4930d2e4-c74e-40c0-9b10-22bbf4c261c7","Type":"ContainerStarted","Data":"295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3"} Jul 23 18:45:49.321038 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.320935 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd4466df-tz8n6" event={"ID":"4930d2e4-c74e-40c0-9b10-22bbf4c261c7","Type":"ContainerStarted","Data":"4a0c847d0d8e21cf08ee4d18be36a5daec3b26b21d4137351995fab453efaf5d"} Jul 23 18:45:49.322416 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.322398 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbcw5" event={"ID":"37421769-7624-4dc7-8132-2b261ee2b2bc","Type":"ContainerStarted","Data":"832f7af0be7b7190069565d4e8fb5ed29153273ecfc7904d6a0185b50d43b20d"} Jul 23 18:45:49.323496 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.323469 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x84vd" event={"ID":"e00077f0-0cf1-4564-8e70-03e238d3cc02","Type":"ContainerStarted","Data":"8816ad813f8c26a21e35da04e0cdad8b816eae7fdb33c06b60bae6490b3fa82e"} Jul 23 18:45:49.342098 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.342049 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74cd4466df-tz8n6" podStartSLOduration=4.342032002 podStartE2EDuration="4.342032002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:49.341357651 +0000 UTC m=+66.803016700" watchObservedRunningTime="2026-07-23 18:45:49.342032002 +0000 UTC m=+66.803691054" Jul 23 18:45:49.384842 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.384799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:49.987419 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.986905 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:49.987419 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.987331 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:49.993729 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:49.993419 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:50.332647 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:50.332575 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:45:50.812664 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:50.812634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:50.913468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:50.913420 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:51.035713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:51.035676 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:51.136805 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:51.136771 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:52.293744 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:52.293716 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d5x2m" Jul 23 18:45:53.174180 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:53.174139 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:53.275911 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:53.275863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:54.035041 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:54.035000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:54.545809 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:54.545778 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:54.624924 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:54.624882 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:56.146882 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.146842 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:56.147412 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.146902 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:56.151731 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.151708 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:56.359781 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.359745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gbcw5" event={"ID":"37421769-7624-4dc7-8132-2b261ee2b2bc","Type":"ContainerStarted","Data":"461e9951a52917d2f5d96a0cc80a0451fc4013ece6d370b255ce97405af81986"} Jul 23 18:45:56.359945 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.359836 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:45:56.361130 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.361107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x84vd" event={"ID":"e00077f0-0cf1-4564-8e70-03e238d3cc02","Type":"ContainerStarted","Data":"be7742a511e35837d0761c5dd240a75cdd085499d930b9d6c1740020f8feaef7"} Jul 23 18:45:56.362829 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.362810 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9c4f" event={"ID":"f6752b02-c2f6-4e21-9684-ca39f89ebccd","Type":"ContainerStarted","Data":"bb224fc19504b3bfad4d7290bac7818de4aac9c50b5122c37882e04dde5bdc74"} Jul 23 18:45:56.367876 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.367847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9qfg" event={"ID":"5e889600-f076-4834-8a7b-90daf2a1fee1","Type":"ContainerStarted","Data":"19b8aac9ff1749946b07820ebc150cae69bada76f296b266a0457b382ed3aa36"} Jul 23 18:45:56.368002 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.367920 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9qfg" event={"ID":"5e889600-f076-4834-8a7b-90daf2a1fee1","Type":"ContainerStarted","Data":"4a2c0d2c5d2b96ef36b5f13295841c60e06e1c8a9467716dfb78b5192a01ab23"} Jul 23 18:45:56.369090 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.369068 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" event={"ID":"f59b3e8a-d1c0-469f-935e-d7c9110c7b9d","Type":"ContainerStarted","Data":"8636ee66de0556fe0fe2e100832a2487ef2299f4819a2e02f7bf6a943b5937eb"} Jul 23 18:45:56.369254 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.369238 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" Jul 23 18:45:56.372987 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.372968 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:45:56.373759 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.373742 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" Jul 23 18:45:56.378704 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.378666 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gbcw5" podStartSLOduration=67.32315298 podStartE2EDuration="1m13.378653722s" totalImagesPullingTime="6.055500742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:56.377980223 +0000 UTC m=+73.839639274" watchObservedRunningTime="2026-07-23 18:45:56.378653722 +0000 UTC m=+73.840312751" Jul 23 18:45:56.396607 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.396540 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n9c4f" podStartSLOduration=2.327298842 podStartE2EDuration="19.396525041s" totalImagesPullingTime="17.069226199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:45:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:56.396505153 +0000 UTC m=+73.858164204" watchObservedRunningTime="2026-07-23 18:45:56.396525041 +0000 UTC m=+73.858184091" Jul 23 18:45:56.415159 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.415061 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x84vd" podStartSLOduration=67.30066051 podStartE2EDuration="1m13.415046266s" totalImagesPullingTime="6.114385756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:56.41459414 +0000 UTC m=+73.876253190" watchObservedRunningTime="2026-07-23 18:45:56.415046266 +0000 UTC m=+73.876705316" Jul 23 18:45:56.455237 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.455181 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-xx5t6" podStartSLOduration=4.518159669 podStartE2EDuration="11.455164286s" totalImagesPullingTime="6.937004617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:56.454177396 +0000 UTC m=+73.915836442" watchObservedRunningTime="2026-07-23 18:45:56.455164286 +0000 UTC m=+73.916823337" Jul 23 18:45:56.480953 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.480902 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l9qfg" podStartSLOduration=67.448742447 podStartE2EDuration="1m13.48088617s" totalImagesPullingTime="6.032143723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:56.480608222 +0000 UTC m=+73.942267274" watchObservedRunningTime="2026-07-23 18:45:56.48088617 +0000 UTC m=+73.942545242" Jul 23 18:45:56.482247 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.482227 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b947bcdf-vp6lf"] Jul 23 18:45:56.655114 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.655073 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:56.779652 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:56.779569 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:57.000407 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:57.000364 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:57.238651 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:57.238615 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:59.340658 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:59.340610 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:45:59.441611 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:45:59.441578 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:01.076039 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:01.075998 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:01.176951 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:01.176909 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:01.574418 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:01.574386 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:01.695653 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:01.695621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:03.175316 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.175256 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:03.345309 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.345151 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:03.540022 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.539861 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:03.626687 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.626656 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wj248"] Jul 23 18:46:03.628520 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.628504 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.631774 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.631750 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 18:46:03.631774 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.631750 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 18:46:03.631937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.631754 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 18:46:03.631937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.631799 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 18:46:03.632144 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.632129 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 18:46:03.632875 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.632861 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 18:46:03.633137 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.633121 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w47kv\"" Jul 23 18:46:03.645510 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.645479 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r2nfd"] Jul 23 18:46:03.647570 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.647555 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.650430 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.650412 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 18:46:03.650520 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.650503 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hdq9c\"" Jul 23 18:46:03.651012 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.650997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 18:46:03.651542 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.651530 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 18:46:03.676720 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.676688 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r2nfd"] Jul 23 18:46:03.718653 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qkpk\" (UniqueName: \"kubernetes.io/projected/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-api-access-8qkpk\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.718653 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-root\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-textfile\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b354878e-798e-4e0f-be8c-0158bbe0627c-metrics-client-ca\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-wtmp\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718853 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d87da466-321d-4dcc-aa1f-5e321b2c25d9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d87da466-321d-4dcc-aa1f-5e321b2c25d9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.718937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-sys\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.719227 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.718998 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.719227 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.719028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.719227 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.719045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.719227 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.719104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-tls\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.719227 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.719133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54dhw\" (UniqueName: \"kubernetes.io/projected/b354878e-798e-4e0f-be8c-0158bbe0627c-kube-api-access-54dhw\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.771510 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.771477 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:03.819708 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819618 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b354878e-798e-4e0f-be8c-0158bbe0627c-metrics-client-ca\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.819708 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-wtmp\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.819708 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819682 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.819708 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d87da466-321d-4dcc-aa1f-5e321b2c25d9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d87da466-321d-4dcc-aa1f-5e321b2c25d9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819777 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-sys\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819805 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819844 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-wtmp\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819880 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-sys\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.819934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820385 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:46:03.820052 2563 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 18:46:03.820385 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:46:03.820129 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-tls podName:d87da466-321d-4dcc-aa1f-5e321b2c25d9 nodeName:}" failed. No retries permitted until 2026-07-23 18:46:04.320110063 +0000 UTC m=+81.781769092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-r2nfd" (UID: "d87da466-321d-4dcc-aa1f-5e321b2c25d9") : secret "kube-state-metrics-tls" not found Jul 23 18:46:03.820385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820161 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d87da466-321d-4dcc-aa1f-5e321b2c25d9-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820385 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820220 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820583 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820382 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b354878e-798e-4e0f-be8c-0158bbe0627c-metrics-client-ca\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820583 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820437 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-accelerators-collector-config\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820583 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820501 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-tls\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820583 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54dhw\" (UniqueName: \"kubernetes.io/projected/b354878e-798e-4e0f-be8c-0158bbe0627c-kube-api-access-54dhw\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820583 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820574 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qkpk\" (UniqueName: \"kubernetes.io/projected/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-api-access-8qkpk\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820828 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820596 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d87da466-321d-4dcc-aa1f-5e321b2c25d9-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820828 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820607 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-root\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820828 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820596 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.820828 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820639 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-textfile\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820828 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b354878e-798e-4e0f-be8c-0158bbe0627c-root\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.820828 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:46:03.820645 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 23 18:46:03.820828 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:46:03.820744 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-tls podName:b354878e-798e-4e0f-be8c-0158bbe0627c nodeName:}" failed. No retries permitted until 2026-07-23 18:46:04.320726519 +0000 UTC m=+81.782385548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-tls") pod "node-exporter-wj248" (UID: "b354878e-798e-4e0f-be8c-0158bbe0627c") : secret "node-exporter-tls" not found Jul 23 18:46:03.821073 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.820871 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-textfile\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.822407 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.822388 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:03.822680 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.822661 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.836384 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.836347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qkpk\" (UniqueName: \"kubernetes.io/projected/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-api-access-8qkpk\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:03.839504 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:03.839480 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54dhw\" (UniqueName: \"kubernetes.io/projected/b354878e-798e-4e0f-be8c-0158bbe0627c-kube-api-access-54dhw\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:04.019709 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.019673 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:04.199974 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.199941 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:04.324390 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.324359 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-tls\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:04.324563 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.324424 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:04.326899 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.326871 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b354878e-798e-4e0f-be8c-0158bbe0627c-node-exporter-tls\") pod \"node-exporter-wj248\" (UID: \"b354878e-798e-4e0f-be8c-0158bbe0627c\") " pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:04.327017 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.326926 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d87da466-321d-4dcc-aa1f-5e321b2c25d9-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-r2nfd\" (UID: \"d87da466-321d-4dcc-aa1f-5e321b2c25d9\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:04.399956 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.399922 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:04.537329 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.537218 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wj248" Jul 23 18:46:04.547007 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:46:04.546974 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb354878e_798e_4e0f_be8c_0158bbe0627c.slice/crio-7af3651a0d77d9322edddd3535d285df35a0f88eb51b6213384d760e1598c567 WatchSource:0}: Error finding container 7af3651a0d77d9322edddd3535d285df35a0f88eb51b6213384d760e1598c567: Status 404 returned error can't find the container with id 7af3651a0d77d9322edddd3535d285df35a0f88eb51b6213384d760e1598c567 Jul 23 18:46:04.556107 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.556084 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" Jul 23 18:46:04.703159 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.703123 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:04.723088 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.723052 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-r2nfd"] Jul 23 18:46:04.728227 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:46:04.728202 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd87da466_321d_4dcc_aa1f_5e321b2c25d9.slice/crio-56a0975b183183ab84b85141a7aa08ccc497e3eadf4a2896cf976ec6b3d30e13 WatchSource:0}: Error finding container 56a0975b183183ab84b85141a7aa08ccc497e3eadf4a2896cf976ec6b3d30e13: Status 404 returned error can't find the container with id 56a0975b183183ab84b85141a7aa08ccc497e3eadf4a2896cf976ec6b3d30e13 Jul 23 18:46:04.863792 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.863675 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:04.863792 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.863762 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 18:46:04.867075 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.867055 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.872354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872322 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 18:46:04.872354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872335 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 18:46:04.872354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872335 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 18:46:04.872642 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872388 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 18:46:04.872642 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872334 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 18:46:04.872642 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872358 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9rqgr\"" Jul 23 18:46:04.872832 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872815 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 18:46:04.872993 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.872976 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 18:46:04.873530 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.873513 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 18:46:04.873952 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.873922 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 18:46:04.901892 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.901855 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 18:46:04.927770 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.927731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.927894 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.927778 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.927894 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.927795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a155132e-5597-49b4-967d-889a4069e08c-config-out\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.927894 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.927840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a155132e-5597-49b4-967d-889a4069e08c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.927894 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.927887 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928043 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.927917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a155132e-5597-49b4-967d-889a4069e08c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928043 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.927935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a155132e-5597-49b4-967d-889a4069e08c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928043 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.928010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928043 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.928038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.928061 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.928080 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th4vs\" (UniqueName: \"kubernetes.io/projected/a155132e-5597-49b4-967d-889a4069e08c-kube-api-access-th4vs\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.928151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-web-config\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:04.928217 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:04.928186 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a155132e-5597-49b4-967d-889a4069e08c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029361 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029361 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029366 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a155132e-5597-49b4-967d-889a4069e08c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a155132e-5597-49b4-967d-889a4069e08c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029431 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029456 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029488 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029513 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4vs\" (UniqueName: \"kubernetes.io/projected/a155132e-5597-49b4-967d-889a4069e08c-kube-api-access-th4vs\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029541 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-web-config\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029564 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a155132e-5597-49b4-967d-889a4069e08c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029617 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029997 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029997 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a155132e-5597-49b4-967d-889a4069e08c-config-out\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.029997 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.029696 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a155132e-5597-49b4-967d-889a4069e08c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.030768 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.030296 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a155132e-5597-49b4-967d-889a4069e08c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.030768 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.030509 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a155132e-5597-49b4-967d-889a4069e08c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.030768 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.030742 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a155132e-5597-49b4-967d-889a4069e08c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.032922 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.032875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.033025 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.032948 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.033064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.033034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.033701 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.033661 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a155132e-5597-49b4-967d-889a4069e08c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.033701 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.033671 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.033701 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.033679 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a155132e-5597-49b4-967d-889a4069e08c-config-out\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.033922 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.033864 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.033996 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.033979 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-web-config\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.035065 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.035047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a155132e-5597-49b4-967d-889a4069e08c-config-volume\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.049097 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.049065 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th4vs\" (UniqueName: \"kubernetes.io/projected/a155132e-5597-49b4-967d-889a4069e08c-kube-api-access-th4vs\") pod \"alertmanager-main-0\" (UID: \"a155132e-5597-49b4-967d-889a4069e08c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.137050 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.137017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:05.176935 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.176902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 18:46:05.340733 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.340698 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 18:46:05.343948 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:46:05.343925 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda155132e_5597_49b4_967d_889a4069e08c.slice/crio-331924e9f1ea6adaa26b53d43604989aa49de45c45a4085dc351fe2604e3ebb0 WatchSource:0}: Error finding container 331924e9f1ea6adaa26b53d43604989aa49de45c45a4085dc351fe2604e3ebb0: Status 404 returned error can't find the container with id 331924e9f1ea6adaa26b53d43604989aa49de45c45a4085dc351fe2604e3ebb0 Jul 23 18:46:05.402052 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.401975 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj248" event={"ID":"b354878e-798e-4e0f-be8c-0158bbe0627c","Type":"ContainerStarted","Data":"7af3651a0d77d9322edddd3535d285df35a0f88eb51b6213384d760e1598c567"} Jul 23 18:46:05.403170 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.403146 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" event={"ID":"d87da466-321d-4dcc-aa1f-5e321b2c25d9","Type":"ContainerStarted","Data":"56a0975b183183ab84b85141a7aa08ccc497e3eadf4a2896cf976ec6b3d30e13"} Jul 23 18:46:05.404252 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.404228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerStarted","Data":"331924e9f1ea6adaa26b53d43604989aa49de45c45a4085dc351fe2604e3ebb0"} Jul 23 18:46:05.544022 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.543979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:05.650174 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:05.650133 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:06.408916 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:06.408884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" event={"ID":"d87da466-321d-4dcc-aa1f-5e321b2c25d9","Type":"ContainerStarted","Data":"18950b19137004521c6d297482cf06badb268ac73e51b84d4275d5542ecf3b2b"} Jul 23 18:46:06.934525 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:06.934475 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:07.044316 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.044257 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:07.155287 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.155238 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:07.273166 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.273130 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:07.415225 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.415187 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj248" event={"ID":"b354878e-798e-4e0f-be8c-0158bbe0627c","Type":"ContainerStarted","Data":"967729f6fde8496029e4d32ebfd4199583cbe76893bbdbac135c7dfcb88b26c7"} Jul 23 18:46:07.417779 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.417715 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" event={"ID":"d87da466-321d-4dcc-aa1f-5e321b2c25d9","Type":"ContainerStarted","Data":"a5e6bc84f53857e82d32dc9de67dcc56f709ed9182222b30f5edcf1ae68f8abe"} Jul 23 18:46:07.417779 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.417774 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" event={"ID":"d87da466-321d-4dcc-aa1f-5e321b2c25d9","Type":"ContainerStarted","Data":"5f25a6ae5dc4655575213d560be6a8fcf165123c0efc4a33e5a3740ec6c34593"} Jul 23 18:46:07.464112 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.464022 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:07.475082 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:07.475030 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-r2nfd" podStartSLOduration=2.866265346 podStartE2EDuration="4.475016506s" totalImagesPullingTime="1.60875116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:07.473845013 +0000 UTC m=+84.935504070" watchObservedRunningTime="2026-07-23 18:46:07.475016506 +0000 UTC m=+84.936675557" Jul 23 18:46:08.231892 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.231859 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn"] Jul 23 18:46:08.233959 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.233941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.238148 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.238125 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wjpn8\"" Jul 23 18:46:08.238241 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.238136 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 18:46:08.240256 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.240091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:08.241702 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.241680 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5677bdcc87-zz7vl"] Jul 23 18:46:08.243789 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.243772 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.260231 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.260206 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn"] Jul 23 18:46:08.263338 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.263315 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5677bdcc87-zz7vl"] Jul 23 18:46:08.362549 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj89j\" (UniqueName: \"kubernetes.io/projected/6abe7ad2-eb02-4de1-ac35-b8d29fde0598-kube-api-access-bj89j\") pod \"monitoring-plugin-7b7b7bc8bf-nxgdn\" (UID: \"6abe7ad2-eb02-4de1-ac35-b8d29fde0598\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.362756 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362566 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbm29\" (UniqueName: \"kubernetes.io/projected/ab884e7c-b465-4679-a209-b2bd99c03f33-kube-api-access-dbm29\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.362756 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362647 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-trusted-ca-bundle\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.362756 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362688 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-serving-cert\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.362756 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-oauth-config\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.362927 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362790 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-service-ca\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.362927 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362841 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-oauth-serving-cert\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.362927 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-console-config\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.362927 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.362911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6abe7ad2-eb02-4de1-ac35-b8d29fde0598-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-nxgdn\" (UID: \"6abe7ad2-eb02-4de1-ac35-b8d29fde0598\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.427043 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.427004 2563 generic.go:356] "Generic (PLEG): container finished" podID="a155132e-5597-49b4-967d-889a4069e08c" containerID="2387b1e93afc5b400fc8652e9fa823429eb943de668f5b5a4301b0bc3a0e086f" exitCode=0 Jul 23 18:46:08.427475 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.427095 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerDied","Data":"2387b1e93afc5b400fc8652e9fa823429eb943de668f5b5a4301b0bc3a0e086f"} Jul 23 18:46:08.428731 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.428706 2563 generic.go:356] "Generic (PLEG): container finished" podID="b354878e-798e-4e0f-be8c-0158bbe0627c" containerID="967729f6fde8496029e4d32ebfd4199583cbe76893bbdbac135c7dfcb88b26c7" exitCode=0 Jul 23 18:46:08.428825 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.428735 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj248" event={"ID":"b354878e-798e-4e0f-be8c-0158bbe0627c","Type":"ContainerDied","Data":"967729f6fde8496029e4d32ebfd4199583cbe76893bbdbac135c7dfcb88b26c7"} Jul 23 18:46:08.463578 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-service-ca\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.463766 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-oauth-serving-cert\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.463766 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463615 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-console-config\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.463766 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6abe7ad2-eb02-4de1-ac35-b8d29fde0598-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-nxgdn\" (UID: \"6abe7ad2-eb02-4de1-ac35-b8d29fde0598\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.463766 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463684 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj89j\" (UniqueName: \"kubernetes.io/projected/6abe7ad2-eb02-4de1-ac35-b8d29fde0598-kube-api-access-bj89j\") pod \"monitoring-plugin-7b7b7bc8bf-nxgdn\" (UID: \"6abe7ad2-eb02-4de1-ac35-b8d29fde0598\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.463766 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463708 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbm29\" (UniqueName: \"kubernetes.io/projected/ab884e7c-b465-4679-a209-b2bd99c03f33-kube-api-access-dbm29\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.463766 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-trusted-ca-bundle\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.463766 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463765 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-serving-cert\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.464111 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.463790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-oauth-config\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.464440 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.464377 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-service-ca\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.464561 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.464480 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-console-config\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.464642 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.464622 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-trusted-ca-bundle\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.464708 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.464683 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-oauth-serving-cert\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.466416 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.466389 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6abe7ad2-eb02-4de1-ac35-b8d29fde0598-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-nxgdn\" (UID: \"6abe7ad2-eb02-4de1-ac35-b8d29fde0598\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.466416 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.466403 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-oauth-config\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.466711 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.466693 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-serving-cert\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.471879 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.471831 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:08.479783 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.479752 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbm29\" (UniqueName: \"kubernetes.io/projected/ab884e7c-b465-4679-a209-b2bd99c03f33-kube-api-access-dbm29\") pod \"console-5677bdcc87-zz7vl\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.480173 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.480151 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj89j\" (UniqueName: \"kubernetes.io/projected/6abe7ad2-eb02-4de1-ac35-b8d29fde0598-kube-api-access-bj89j\") pod \"monitoring-plugin-7b7b7bc8bf-nxgdn\" (UID: \"6abe7ad2-eb02-4de1-ac35-b8d29fde0598\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.542835 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.542811 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:08.552138 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.552112 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:08.711416 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.711205 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn"] Jul 23 18:46:08.713874 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:46:08.713845 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abe7ad2_eb02_4de1_ac35_b8d29fde0598.slice/crio-a598bce3906fbb058d3309b326914d1e0e1837c0cabd87d9e0e3ea83b348ac76 WatchSource:0}: Error finding container a598bce3906fbb058d3309b326914d1e0e1837c0cabd87d9e0e3ea83b348ac76: Status 404 returned error can't find the container with id a598bce3906fbb058d3309b326914d1e0e1837c0cabd87d9e0e3ea83b348ac76 Jul 23 18:46:08.736338 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:08.736311 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5677bdcc87-zz7vl"] Jul 23 18:46:08.739446 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:46:08.739423 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab884e7c_b465_4679_a209_b2bd99c03f33.slice/crio-3a04138d9cc31f1639eb16183bd3d1ceba118c60ec3a331dd5db2584949b343a WatchSource:0}: Error finding container 3a04138d9cc31f1639eb16183bd3d1ceba118c60ec3a331dd5db2584949b343a: Status 404 returned error can't find the container with id 3a04138d9cc31f1639eb16183bd3d1ceba118c60ec3a331dd5db2584949b343a Jul 23 18:46:09.434376 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:09.434338 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" event={"ID":"6abe7ad2-eb02-4de1-ac35-b8d29fde0598","Type":"ContainerStarted","Data":"a598bce3906fbb058d3309b326914d1e0e1837c0cabd87d9e0e3ea83b348ac76"} Jul 23 18:46:09.437158 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:09.437127 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj248" event={"ID":"b354878e-798e-4e0f-be8c-0158bbe0627c","Type":"ContainerStarted","Data":"97f158318104890381a63a0bee03f7a790eb83487818d09d3139016fd02a76dd"} Jul 23 18:46:09.437331 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:09.437180 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wj248" event={"ID":"b354878e-798e-4e0f-be8c-0158bbe0627c","Type":"ContainerStarted","Data":"ac8259ca25524cb899f0a41d50979fe47896abfdaa2dff97a2294afd4dcdca20"} Jul 23 18:46:09.438792 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:09.438766 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677bdcc87-zz7vl" event={"ID":"ab884e7c-b465-4679-a209-b2bd99c03f33","Type":"ContainerStarted","Data":"746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4"} Jul 23 18:46:09.438898 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:09.438812 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677bdcc87-zz7vl" event={"ID":"ab884e7c-b465-4679-a209-b2bd99c03f33","Type":"ContainerStarted","Data":"3a04138d9cc31f1639eb16183bd3d1ceba118c60ec3a331dd5db2584949b343a"} Jul 23 18:46:09.463723 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:09.463653 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wj248" podStartSLOduration=3.7649379720000002 podStartE2EDuration="6.463632517s" totalImagesPullingTime="2.618167717s" totalInitContainerRuntime="80.526828ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:09.461464299 +0000 UTC m=+86.923123362" watchObservedRunningTime="2026-07-23 18:46:09.463632517 +0000 UTC m=+86.925291570" Jul 23 18:46:09.493090 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:09.491403 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5677bdcc87-zz7vl" podStartSLOduration=1.491382332 podStartE2EDuration="1.491382332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:09.489971996 +0000 UTC m=+86.951631049" watchObservedRunningTime="2026-07-23 18:46:09.491382332 +0000 UTC m=+86.953041383" Jul 23 18:46:10.307905 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.307876 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:46:10.311280 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.311247 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.315471 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.315300 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 18:46:10.315748 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.315721 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 18:46:10.315864 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.315790 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 18:46:10.317388 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.316050 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 18:46:10.317788 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.317764 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 18:46:10.317937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.317916 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 18:46:10.318031 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.317934 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 18:46:10.318031 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.318003 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vwph6\"" Jul 23 18:46:10.318203 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.318006 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 18:46:10.318203 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.318175 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 18:46:10.318375 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.318357 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-nqsatsi0h3l9\"" Jul 23 18:46:10.318478 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.318356 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 18:46:10.320489 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.320461 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 18:46:10.320606 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.320487 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 18:46:10.320663 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.320606 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 18:46:10.325025 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.324997 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:10.325124 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.325075 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 18:46:10.328859 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.328844 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 18:46:10.345850 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.345803 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:46:10.379984 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.379961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qq2\" (UniqueName: \"kubernetes.io/projected/57251b99-f14d-47a6-979d-3bd282fc8580-kube-api-access-j2qq2\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380057 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380242 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380122 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380242 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380174 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380242 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-web-config\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380352 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380398 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380359 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380398 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380384 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380479 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380479 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380420 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57251b99-f14d-47a6-979d-3bd282fc8580-config-out\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380479 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380443 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380601 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-config\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380601 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380550 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380601 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380575 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380726 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57251b99-f14d-47a6-979d-3bd282fc8580-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380726 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380626 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380726 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380645 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.380726 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.380678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.445165 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.445123 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerStarted","Data":"153b2138f74a312f094f4d4f0834063ec9b3928c7dfcb622d4e87371ad449cef"} Jul 23 18:46:10.445495 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.445188 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerStarted","Data":"7bb1e1454e43cad4d9a8a1e1e0d9dd1db5120b2d9a55d1438067e2b5f6940e56"} Jul 23 18:46:10.445495 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.445215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerStarted","Data":"9cf243908706fbe50b4e87bbfea142be8f304a9e2b91025c929bfa269ae41b99"} Jul 23 18:46:10.481583 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481553 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-config\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481591 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481610 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57251b99-f14d-47a6-979d-3bd282fc8580-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481679 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481724 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481704 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481903 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qq2\" (UniqueName: \"kubernetes.io/projected/57251b99-f14d-47a6-979d-3bd282fc8580-kube-api-access-j2qq2\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481903 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481903 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481793 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481903 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481903 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481839 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.481903 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.482064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-web-config\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.482064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.482064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.481982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.482064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.482020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.482064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.482051 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.482363 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.482079 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57251b99-f14d-47a6-979d-3bd282fc8580-config-out\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.482363 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.482109 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.483048 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.483023 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.483416 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.483392 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.484947 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.485117 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/57251b99-f14d-47a6-979d-3bd282fc8580-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.485172 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.485713 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.485756 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.486590 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.486602 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.486831 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.486153 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.486906 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-config\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.488501 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.487021 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.488501 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.487892 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/57251b99-f14d-47a6-979d-3bd282fc8580-config-out\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.488501 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.487901 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/57251b99-f14d-47a6-979d-3bd282fc8580-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.488501 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.488395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.488716 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.488693 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.489158 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.489121 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-web-config\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.489641 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.489621 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.490014 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.489994 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/57251b99-f14d-47a6-979d-3bd282fc8580-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.496437 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.496416 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qq2\" (UniqueName: \"kubernetes.io/projected/57251b99-f14d-47a6-979d-3bd282fc8580-kube-api-access-j2qq2\") pod \"prometheus-k8s-0\" (UID: \"57251b99-f14d-47a6-979d-3bd282fc8580\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.635356 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.635321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:10.743211 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.743175 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:10.813818 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.813783 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:46:10.820077 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:46:10.820051 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57251b99_f14d_47a6_979d_3bd282fc8580.slice/crio-33aff303835e20be24765d05901c7f9fbf1b2de24e006656744a7bd9ae25bb47 WatchSource:0}: Error finding container 33aff303835e20be24765d05901c7f9fbf1b2de24e006656744a7bd9ae25bb47: Status 404 returned error can't find the container with id 33aff303835e20be24765d05901c7f9fbf1b2de24e006656744a7bd9ae25bb47 Jul 23 18:46:10.871248 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:10.871183 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:11.028435 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.028254 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:11.455012 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.454973 2563 generic.go:356] "Generic (PLEG): container finished" podID="57251b99-f14d-47a6-979d-3bd282fc8580" containerID="c1b329060797ea5089a241f0191b7aca8ceaffec7171cb05874cfc637095cc26" exitCode=0 Jul 23 18:46:11.455474 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.455057 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerDied","Data":"c1b329060797ea5089a241f0191b7aca8ceaffec7171cb05874cfc637095cc26"} Jul 23 18:46:11.455474 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.455159 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerStarted","Data":"33aff303835e20be24765d05901c7f9fbf1b2de24e006656744a7bd9ae25bb47"} Jul 23 18:46:11.456728 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.456699 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" event={"ID":"6abe7ad2-eb02-4de1-ac35-b8d29fde0598","Type":"ContainerStarted","Data":"cfcd0ad56ae3536cd650793a5ea57ca13661ec02c82bfcfa50eccd95693df511"} Jul 23 18:46:11.461090 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.461067 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerStarted","Data":"11c25b8c7f2da13b26d12a155090395521706dd75993ae5da57ec6e3019aa49d"} Jul 23 18:46:11.461219 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.461129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerStarted","Data":"261f8ce11e18b78435600def7e317b38473be64df0e0304167aa7d0cb2b2b2a2"} Jul 23 18:46:11.543722 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:11.543615 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" podStartSLOduration=1.032404425 podStartE2EDuration="3.543596941s" totalImagesPullingTime="2.511192516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:11.542004082 +0000 UTC m=+89.003663134" watchObservedRunningTime="2026-07-23 18:46:11.543596941 +0000 UTC m=+89.005256008" Jul 23 18:46:12.467920 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:12.467881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a155132e-5597-49b4-967d-889a4069e08c","Type":"ContainerStarted","Data":"e2adb7acbf8aa1386c01c7660d1020c50ae824e4997582b9081b6e27701ecd61"} Jul 23 18:46:12.468406 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:12.468039 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:12.472956 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:12.472935 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-nxgdn" Jul 23 18:46:12.508472 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:12.508406 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.417975442 podStartE2EDuration="8.508388743s" totalImagesPullingTime="5.074331241s" totalInitContainerRuntime="16.08206ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:46:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:12.507457602 +0000 UTC m=+89.969116655" watchObservedRunningTime="2026-07-23 18:46:12.508388743 +0000 UTC m=+89.970047808" Jul 23 18:46:16.487568 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:16.487534 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerStarted","Data":"e78d87e313cd6427ad2ebfce1fd1905ddab5d47fc99203d9d42f7fbdf78c8e30"} Jul 23 18:46:16.488037 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:16.487607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerStarted","Data":"12089dc870eab831cc76861fbb25d6f79da94b1a12eae8b248836595b98259b6"} Jul 23 18:46:18.498604 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:18.498561 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerStarted","Data":"4472b47abb9b39178b1596ae7f522cdb3e57f4f933761d6b36b508e317885cce"} Jul 23 18:46:18.498968 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:18.498693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerStarted","Data":"58356dd822ea97657a0358e9a3685369e088989801d2657990dc0cf6356f0f64"} Jul 23 18:46:18.553065 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:18.553029 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:18.553239 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:18.553093 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:18.558149 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:18.558127 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:19.505411 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.505370 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerStarted","Data":"4f5cbb4063ba7c0e6f7c1a9e3341eafcc1c1f22f3ccbb381ef409b6299a2a973"} Jul 23 18:46:19.505788 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.505439 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"57251b99-f14d-47a6-979d-3bd282fc8580","Type":"ContainerStarted","Data":"7c584560f67b3bba9fe121a78747b772984a9119c447934508c7fcf24f69c91a"} Jul 23 18:46:19.510094 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.510070 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:46:19.547889 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.547819 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.021503837 podStartE2EDuration="9.547799299s" totalImagesPullingTime="6.502673423s" totalInitContainerRuntime="23.622039ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:46:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:46:19.546538194 +0000 UTC m=+97.008197245" watchObservedRunningTime="2026-07-23 18:46:19.547799299 +0000 UTC m=+97.009458351" Jul 23 18:46:19.616607 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.616571 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74cd4466df-tz8n6"] Jul 23 18:46:19.750672 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.750628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:19.850006 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.849896 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:19.954085 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:19.954054 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:20.636337 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:20.636299 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:46:20.809055 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:20.809023 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx9s7_2ce92595-1253-445a-8342-4b596317c73f/serve-healthcheck-canary/0.log" Jul 23 18:46:21.503352 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.503302 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78b947bcdf-vp6lf" podUID="da40e170-a23d-4a22-8c68-2b15ecc0bc1b" containerName="console" containerID="cri-o://467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4" gracePeriod=15 Jul 23 18:46:21.799059 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.799024 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:46:21.888928 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.888893 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-oauth-config\") pod \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " Jul 23 18:46:21.889124 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.888947 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xjkq\" (UniqueName: \"kubernetes.io/projected/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-kube-api-access-5xjkq\") pod \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " Jul 23 18:46:21.889124 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.888976 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-service-ca\") pod \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " Jul 23 18:46:21.889124 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.889020 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-serving-cert\") pod \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " Jul 23 18:46:21.889124 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.889044 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-config\") pod \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " Jul 23 18:46:21.889374 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.889152 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-oauth-serving-cert\") pod \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\" (UID: \"da40e170-a23d-4a22-8c68-2b15ecc0bc1b\") " Jul 23 18:46:21.889577 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.889548 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-config" (OuterVolumeSpecName: "console-config") pod "da40e170-a23d-4a22-8c68-2b15ecc0bc1b" (UID: "da40e170-a23d-4a22-8c68-2b15ecc0bc1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:46:21.889670 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.889617 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "da40e170-a23d-4a22-8c68-2b15ecc0bc1b" (UID: "da40e170-a23d-4a22-8c68-2b15ecc0bc1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:46:21.889965 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.889942 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-service-ca" (OuterVolumeSpecName: "service-ca") pod "da40e170-a23d-4a22-8c68-2b15ecc0bc1b" (UID: "da40e170-a23d-4a22-8c68-2b15ecc0bc1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:46:21.891646 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.891615 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-kube-api-access-5xjkq" (OuterVolumeSpecName: "kube-api-access-5xjkq") pod "da40e170-a23d-4a22-8c68-2b15ecc0bc1b" (UID: "da40e170-a23d-4a22-8c68-2b15ecc0bc1b"). InnerVolumeSpecName "kube-api-access-5xjkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:46:21.891646 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.891624 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "da40e170-a23d-4a22-8c68-2b15ecc0bc1b" (UID: "da40e170-a23d-4a22-8c68-2b15ecc0bc1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:46:21.891772 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.891655 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "da40e170-a23d-4a22-8c68-2b15ecc0bc1b" (UID: "da40e170-a23d-4a22-8c68-2b15ecc0bc1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:46:21.990818 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.990784 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:21.990818 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.990811 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xjkq\" (UniqueName: \"kubernetes.io/projected/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-kube-api-access-5xjkq\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:21.990818 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.990821 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:21.991047 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.990830 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:21.991047 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.990838 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:21.991047 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:21.990848 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/da40e170-a23d-4a22-8c68-2b15ecc0bc1b-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:22.517880 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.517843 2563 generic.go:356] "Generic (PLEG): container finished" podID="da40e170-a23d-4a22-8c68-2b15ecc0bc1b" containerID="467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4" exitCode=0 Jul 23 18:46:22.518071 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.517907 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78b947bcdf-vp6lf" Jul 23 18:46:22.518071 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.517917 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b947bcdf-vp6lf" event={"ID":"da40e170-a23d-4a22-8c68-2b15ecc0bc1b","Type":"ContainerDied","Data":"467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4"} Jul 23 18:46:22.518071 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.517966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78b947bcdf-vp6lf" event={"ID":"da40e170-a23d-4a22-8c68-2b15ecc0bc1b","Type":"ContainerDied","Data":"238695bc7892d9af766df22ef95c2e440e0f326d8d17589132146ccd15030757"} Jul 23 18:46:22.518071 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.518005 2563 scope.go:117] "RemoveContainer" containerID="467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4" Jul 23 18:46:22.526897 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.526877 2563 scope.go:117] "RemoveContainer" containerID="467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4" Jul 23 18:46:22.527177 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:46:22.527159 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4\": container with ID starting with 467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4 not found: ID does not exist" containerID="467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4" Jul 23 18:46:22.527223 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.527185 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4"} err="failed to get container status \"467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4\": rpc error: code = NotFound desc = could not find container \"467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4\": container with ID starting with 467ac8beff2ef04e9614ca606d0310838e341d2b8e3e789d26d8f2bf68badbe4 not found: ID does not exist" Jul 23 18:46:22.553260 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.553221 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78b947bcdf-vp6lf"] Jul 23 18:46:22.554365 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:22.554344 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78b947bcdf-vp6lf"] Jul 23 18:46:23.053997 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:23.053956 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da40e170-a23d-4a22-8c68-2b15ecc0bc1b" path="/var/lib/kubelet/pods/da40e170-a23d-4a22-8c68-2b15ecc0bc1b/volumes" Jul 23 18:46:23.171445 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:23.171410 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:23.276512 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:23.276477 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:24.683068 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:24.683030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:24.793182 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:24.793149 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:27.375839 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:27.375800 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gbcw5" Jul 23 18:46:38.175360 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:38.175310 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:38.270182 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:38.270149 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:46:44.637023 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.636959 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-74cd4466df-tz8n6" podUID="4930d2e4-c74e-40c0-9b10-22bbf4c261c7" containerName="console" containerID="cri-o://295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3" gracePeriod=15 Jul 23 18:46:44.879729 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.879699 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:46:44.983567 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983475 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-oauth-serving-cert\") pod \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " Jul 23 18:46:44.983567 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983551 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-oauth-config\") pod \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " Jul 23 18:46:44.983801 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983581 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-service-ca\") pod \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " Jul 23 18:46:44.983801 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983606 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-serving-cert\") pod \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " Jul 23 18:46:44.983801 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983640 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-config\") pod \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " Jul 23 18:46:44.983801 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983668 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2mj6\" (UniqueName: \"kubernetes.io/projected/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-kube-api-access-f2mj6\") pod \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " Jul 23 18:46:44.983801 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983706 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-trusted-ca-bundle\") pod \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\" (UID: \"4930d2e4-c74e-40c0-9b10-22bbf4c261c7\") " Jul 23 18:46:44.984048 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.983986 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "4930d2e4-c74e-40c0-9b10-22bbf4c261c7" (UID: "4930d2e4-c74e-40c0-9b10-22bbf4c261c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:46:44.984048 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.984004 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4930d2e4-c74e-40c0-9b10-22bbf4c261c7" (UID: "4930d2e4-c74e-40c0-9b10-22bbf4c261c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:46:44.984145 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.984098 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-config" (OuterVolumeSpecName: "console-config") pod "4930d2e4-c74e-40c0-9b10-22bbf4c261c7" (UID: "4930d2e4-c74e-40c0-9b10-22bbf4c261c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:46:44.984221 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.984201 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4930d2e4-c74e-40c0-9b10-22bbf4c261c7" (UID: "4930d2e4-c74e-40c0-9b10-22bbf4c261c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:46:44.985876 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.985856 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4930d2e4-c74e-40c0-9b10-22bbf4c261c7" (UID: "4930d2e4-c74e-40c0-9b10-22bbf4c261c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:46:44.986357 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.986326 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4930d2e4-c74e-40c0-9b10-22bbf4c261c7" (UID: "4930d2e4-c74e-40c0-9b10-22bbf4c261c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:46:44.986459 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:44.986354 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-kube-api-access-f2mj6" (OuterVolumeSpecName: "kube-api-access-f2mj6") pod "4930d2e4-c74e-40c0-9b10-22bbf4c261c7" (UID: "4930d2e4-c74e-40c0-9b10-22bbf4c261c7"). InnerVolumeSpecName "kube-api-access-f2mj6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:46:45.084685 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.084653 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:45.084685 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.084681 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:45.084851 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.084713 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:45.084851 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.084722 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:45.084851 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.084730 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:45.084851 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.084739 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:45.084851 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.084747 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2mj6\" (UniqueName: \"kubernetes.io/projected/4930d2e4-c74e-40c0-9b10-22bbf4c261c7-kube-api-access-f2mj6\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:46:45.612436 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.612397 2563 generic.go:356] "Generic (PLEG): container finished" podID="4930d2e4-c74e-40c0-9b10-22bbf4c261c7" containerID="295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3" exitCode=0 Jul 23 18:46:45.612630 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.612446 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74cd4466df-tz8n6" Jul 23 18:46:45.612630 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.612476 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd4466df-tz8n6" event={"ID":"4930d2e4-c74e-40c0-9b10-22bbf4c261c7","Type":"ContainerDied","Data":"295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3"} Jul 23 18:46:45.612630 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.612533 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74cd4466df-tz8n6" event={"ID":"4930d2e4-c74e-40c0-9b10-22bbf4c261c7","Type":"ContainerDied","Data":"4a0c847d0d8e21cf08ee4d18be36a5daec3b26b21d4137351995fab453efaf5d"} Jul 23 18:46:45.612630 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.612557 2563 scope.go:117] "RemoveContainer" containerID="295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3" Jul 23 18:46:45.620779 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.620762 2563 scope.go:117] "RemoveContainer" containerID="295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3" Jul 23 18:46:45.621046 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:46:45.621027 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3\": container with ID starting with 295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3 not found: ID does not exist" containerID="295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3" Jul 23 18:46:45.621091 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.621057 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3"} err="failed to get container status \"295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3\": rpc error: code = NotFound desc = could not find container \"295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3\": container with ID starting with 295320b231f1bd80dccab9fcfa18fd6e91a06bb86912a06484c67f938bff49e3 not found: ID does not exist" Jul 23 18:46:45.643540 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.643517 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74cd4466df-tz8n6"] Jul 23 18:46:45.650451 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:45.650429 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74cd4466df-tz8n6"] Jul 23 18:46:47.054007 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:47.053971 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4930d2e4-c74e-40c0-9b10-22bbf4c261c7" path="/var/lib/kubelet/pods/4930d2e4-c74e-40c0-9b10-22bbf4c261c7/volumes" Jul 23 18:46:52.996613 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:46:52.996581 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:10.636616 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:10.636576 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:47:10.656411 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:10.656387 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:47:10.720311 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:10.720284 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:47:23.278179 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:23.278145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:23.563064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:23.562965 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:33.487688 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.487612 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8959ffbcf-v42h7"] Jul 23 18:47:33.488034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.487899 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4930d2e4-c74e-40c0-9b10-22bbf4c261c7" containerName="console" Jul 23 18:47:33.488034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.487944 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4930d2e4-c74e-40c0-9b10-22bbf4c261c7" containerName="console" Jul 23 18:47:33.488034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.487959 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da40e170-a23d-4a22-8c68-2b15ecc0bc1b" containerName="console" Jul 23 18:47:33.488034 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.487964 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="da40e170-a23d-4a22-8c68-2b15ecc0bc1b" containerName="console" Jul 23 18:47:33.488168 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.488047 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4930d2e4-c74e-40c0-9b10-22bbf4c261c7" containerName="console" Jul 23 18:47:33.488168 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.488059 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="da40e170-a23d-4a22-8c68-2b15ecc0bc1b" containerName="console" Jul 23 18:47:33.490147 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.490131 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.508297 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.508241 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8959ffbcf-v42h7"] Jul 23 18:47:33.571396 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.571361 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:33.583900 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.583876 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-trusted-ca-bundle\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.583995 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.583906 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-oauth-config\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.583995 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.583922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-serving-cert\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.583995 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.583937 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h2ng\" (UniqueName: \"kubernetes.io/projected/bf3b00d3-3322-450e-94a0-8086264ddca2-kube-api-access-2h2ng\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.583995 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.583960 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-service-ca\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.584135 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.584004 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-console-config\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.584135 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.584029 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-oauth-serving-cert\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.675181 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.675145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:33.685054 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-trusted-ca-bundle\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.685175 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685063 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-oauth-config\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.685175 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685080 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-serving-cert\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.685175 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685145 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h2ng\" (UniqueName: \"kubernetes.io/projected/bf3b00d3-3322-450e-94a0-8086264ddca2-kube-api-access-2h2ng\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.685366 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-service-ca\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.685366 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685226 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-console-config\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.685366 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-oauth-serving-cert\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.686026 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685997 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-service-ca\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.686157 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.685997 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-oauth-serving-cert\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.691777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.686988 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-trusted-ca-bundle\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.691777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.687299 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-console-config\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.691777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.688339 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-serving-cert\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.693300 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.693242 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-oauth-config\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.695686 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.695661 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h2ng\" (UniqueName: \"kubernetes.io/projected/bf3b00d3-3322-450e-94a0-8086264ddca2-kube-api-access-2h2ng\") pod \"console-8959ffbcf-v42h7\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.801483 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.801401 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:33.935194 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:33.935084 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8959ffbcf-v42h7"] Jul 23 18:47:33.937785 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:47:33.937762 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3b00d3_3322_450e_94a0_8086264ddca2.slice/crio-77be3999c21648a851d29e4518bda7eb6833af3d99aa4181fd3e262dd5baa1bd WatchSource:0}: Error finding container 77be3999c21648a851d29e4518bda7eb6833af3d99aa4181fd3e262dd5baa1bd: Status 404 returned error can't find the container with id 77be3999c21648a851d29e4518bda7eb6833af3d99aa4181fd3e262dd5baa1bd Jul 23 18:47:34.792020 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:34.791976 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8959ffbcf-v42h7" event={"ID":"bf3b00d3-3322-450e-94a0-8086264ddca2","Type":"ContainerStarted","Data":"1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0"} Jul 23 18:47:34.792446 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:34.792044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8959ffbcf-v42h7" event={"ID":"bf3b00d3-3322-450e-94a0-8086264ddca2","Type":"ContainerStarted","Data":"77be3999c21648a851d29e4518bda7eb6833af3d99aa4181fd3e262dd5baa1bd"} Jul 23 18:47:34.821049 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:34.820994 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8959ffbcf-v42h7" podStartSLOduration=1.820975958 podStartE2EDuration="1.820975958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:47:34.818588391 +0000 UTC m=+172.280247442" watchObservedRunningTime="2026-07-23 18:47:34.820975958 +0000 UTC m=+172.282635012" Jul 23 18:47:38.579322 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:38.579239 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:38.646535 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:38.646499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:43.801972 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:43.801938 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:43.802419 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:43.802140 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:43.806840 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:43.806818 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:43.830097 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:43.830075 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:47:43.956102 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:43.956074 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5677bdcc87-zz7vl"] Jul 23 18:47:44.209963 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.209922 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69cd46dc4d-ph7l5"] Jul 23 18:47:44.214562 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.214542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.233410 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.233384 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cd46dc4d-ph7l5"] Jul 23 18:47:44.233894 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.233853 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:44.270129 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.270089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-serving-cert\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.270342 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.270154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzm2x\" (UniqueName: \"kubernetes.io/projected/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-kube-api-access-tzm2x\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.270342 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.270207 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-trusted-ca-bundle\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.270342 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.270234 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-oauth-serving-cert\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.270342 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.270302 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-service-ca\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.270572 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.270344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-config\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.270572 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.270455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-oauth-config\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.328231 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.328185 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:44.370967 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.370925 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-oauth-config\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.371156 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.370977 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-serving-cert\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.371156 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.371018 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzm2x\" (UniqueName: \"kubernetes.io/projected/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-kube-api-access-tzm2x\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.371156 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.371043 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-trusted-ca-bundle\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.371156 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.371068 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-oauth-serving-cert\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.371156 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.371106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-service-ca\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.371156 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.371140 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-config\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.371941 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.371905 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-config\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.372922 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.372894 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-oauth-serving-cert\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.373055 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.372987 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-service-ca\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.373679 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.373650 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-trusted-ca-bundle\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.377856 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.377828 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-serving-cert\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.377942 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.377885 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-console-oauth-config\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.383603 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.383576 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzm2x\" (UniqueName: \"kubernetes.io/projected/0f0e2ea0-1f81-4bda-9c1d-f07a20565e27-kube-api-access-tzm2x\") pod \"console-69cd46dc4d-ph7l5\" (UID: \"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27\") " pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.523695 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.523600 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:44.672629 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.672596 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69cd46dc4d-ph7l5"] Jul 23 18:47:44.673392 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.673356 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:44.673962 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:47:44.673941 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0e2ea0_1f81_4bda_9c1d_f07a20565e27.slice/crio-d930d03dbc742cd8ed2c9a8f1ad4455f1d4664e5bb40fc453b65eab4f6333055 WatchSource:0}: Error finding container d930d03dbc742cd8ed2c9a8f1ad4455f1d4664e5bb40fc453b65eab4f6333055: Status 404 returned error can't find the container with id d930d03dbc742cd8ed2c9a8f1ad4455f1d4664e5bb40fc453b65eab4f6333055 Jul 23 18:47:44.831494 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.831410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cd46dc4d-ph7l5" event={"ID":"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27","Type":"ContainerStarted","Data":"7237396cadc856d6674b4b2bd135e90fe0fea40ac9b73ef116da4a96f0c9c699"} Jul 23 18:47:44.831494 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.831470 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69cd46dc4d-ph7l5" event={"ID":"0f0e2ea0-1f81-4bda-9c1d-f07a20565e27","Type":"ContainerStarted","Data":"d930d03dbc742cd8ed2c9a8f1ad4455f1d4664e5bb40fc453b65eab4f6333055"} Jul 23 18:47:44.862798 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:44.862742 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69cd46dc4d-ph7l5" podStartSLOduration=0.862726405 podStartE2EDuration="862.726405ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:47:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:47:44.860854516 +0000 UTC m=+182.322513566" watchObservedRunningTime="2026-07-23 18:47:44.862726405 +0000 UTC m=+182.324385455" Jul 23 18:47:50.501018 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:50.500981 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:50.582956 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:50.582918 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:50.837086 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:50.836996 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:50.938184 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:50.938148 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:53.167487 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:53.167447 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:53.301978 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:53.301920 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:54.524016 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:54.523974 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:54.524518 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:54.524082 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:54.528907 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:54.528879 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:54.875784 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:54.875706 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69cd46dc4d-ph7l5" Jul 23 18:47:54.950683 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:54.950655 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8959ffbcf-v42h7"] Jul 23 18:47:55.086214 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:55.086169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:55.189950 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:55.189907 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:47:55.302028 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:47:55.301988 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:48:08.976308 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:08.976246 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5677bdcc87-zz7vl" podUID="ab884e7c-b465-4679-a209-b2bd99c03f33" containerName="console" containerID="cri-o://746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4" gracePeriod=15 Jul 23 18:48:09.222176 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.222150 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:48:09.396118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396087 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-oauth-serving-cert\") pod \"ab884e7c-b465-4679-a209-b2bd99c03f33\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " Jul 23 18:48:09.396318 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396128 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbm29\" (UniqueName: \"kubernetes.io/projected/ab884e7c-b465-4679-a209-b2bd99c03f33-kube-api-access-dbm29\") pod \"ab884e7c-b465-4679-a209-b2bd99c03f33\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " Jul 23 18:48:09.396318 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396154 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-serving-cert\") pod \"ab884e7c-b465-4679-a209-b2bd99c03f33\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " Jul 23 18:48:09.396318 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396170 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-service-ca\") pod \"ab884e7c-b465-4679-a209-b2bd99c03f33\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " Jul 23 18:48:09.396318 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396256 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-oauth-config\") pod \"ab884e7c-b465-4679-a209-b2bd99c03f33\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " Jul 23 18:48:09.396566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396359 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-trusted-ca-bundle\") pod \"ab884e7c-b465-4679-a209-b2bd99c03f33\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " Jul 23 18:48:09.396566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396383 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-console-config\") pod \"ab884e7c-b465-4679-a209-b2bd99c03f33\" (UID: \"ab884e7c-b465-4679-a209-b2bd99c03f33\") " Jul 23 18:48:09.396566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396530 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ab884e7c-b465-4679-a209-b2bd99c03f33" (UID: "ab884e7c-b465-4679-a209-b2bd99c03f33"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:09.396713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396595 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-service-ca" (OuterVolumeSpecName: "service-ca") pod "ab884e7c-b465-4679-a209-b2bd99c03f33" (UID: "ab884e7c-b465-4679-a209-b2bd99c03f33"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:09.396779 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396659 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:09.396831 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396778 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:09.396881 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396834 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-console-config" (OuterVolumeSpecName: "console-config") pod "ab884e7c-b465-4679-a209-b2bd99c03f33" (UID: "ab884e7c-b465-4679-a209-b2bd99c03f33"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:09.396881 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.396855 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ab884e7c-b465-4679-a209-b2bd99c03f33" (UID: "ab884e7c-b465-4679-a209-b2bd99c03f33"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:09.398465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.398435 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ab884e7c-b465-4679-a209-b2bd99c03f33" (UID: "ab884e7c-b465-4679-a209-b2bd99c03f33"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:48:09.398563 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.398528 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab884e7c-b465-4679-a209-b2bd99c03f33-kube-api-access-dbm29" (OuterVolumeSpecName: "kube-api-access-dbm29") pod "ab884e7c-b465-4679-a209-b2bd99c03f33" (UID: "ab884e7c-b465-4679-a209-b2bd99c03f33"). InnerVolumeSpecName "kube-api-access-dbm29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:48:09.398598 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.398553 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ab884e7c-b465-4679-a209-b2bd99c03f33" (UID: "ab884e7c-b465-4679-a209-b2bd99c03f33"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:48:09.498151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.498112 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbm29\" (UniqueName: \"kubernetes.io/projected/ab884e7c-b465-4679-a209-b2bd99c03f33-kube-api-access-dbm29\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:09.498151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.498144 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:09.498151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.498154 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ab884e7c-b465-4679-a209-b2bd99c03f33-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:09.498151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.498162 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:09.498437 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.498172 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ab884e7c-b465-4679-a209-b2bd99c03f33-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:09.929359 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.929321 2563 generic.go:356] "Generic (PLEG): container finished" podID="ab884e7c-b465-4679-a209-b2bd99c03f33" containerID="746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4" exitCode=0 Jul 23 18:48:09.929520 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.929374 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5677bdcc87-zz7vl" Jul 23 18:48:09.929520 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.929390 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677bdcc87-zz7vl" event={"ID":"ab884e7c-b465-4679-a209-b2bd99c03f33","Type":"ContainerDied","Data":"746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4"} Jul 23 18:48:09.929520 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.929442 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5677bdcc87-zz7vl" event={"ID":"ab884e7c-b465-4679-a209-b2bd99c03f33","Type":"ContainerDied","Data":"3a04138d9cc31f1639eb16183bd3d1ceba118c60ec3a331dd5db2584949b343a"} Jul 23 18:48:09.929520 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.929470 2563 scope.go:117] "RemoveContainer" containerID="746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4" Jul 23 18:48:09.939880 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.939844 2563 scope.go:117] "RemoveContainer" containerID="746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4" Jul 23 18:48:09.940228 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:48:09.940209 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4\": container with ID starting with 746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4 not found: ID does not exist" containerID="746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4" Jul 23 18:48:09.940338 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.940236 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4"} err="failed to get container status \"746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4\": rpc error: code = NotFound desc = could not find container \"746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4\": container with ID starting with 746483ffe563315654b875348ac08150819a6799f35878ec5afd13d8a75b31c4 not found: ID does not exist" Jul 23 18:48:09.955865 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.955841 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5677bdcc87-zz7vl"] Jul 23 18:48:09.960257 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:09.960233 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5677bdcc87-zz7vl"] Jul 23 18:48:11.054208 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:11.054171 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab884e7c-b465-4679-a209-b2bd99c03f33" path="/var/lib/kubelet/pods/ab884e7c-b465-4679-a209-b2bd99c03f33/volumes" Jul 23 18:48:15.343576 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:15.343542 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:48:19.971606 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:19.971542 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8959ffbcf-v42h7" podUID="bf3b00d3-3322-450e-94a0-8086264ddca2" containerName="console" containerID="cri-o://1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0" gracePeriod=15 Jul 23 18:48:20.211408 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.211382 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:48:20.282634 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.282556 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2h2ng\" (UniqueName: \"kubernetes.io/projected/bf3b00d3-3322-450e-94a0-8086264ddca2-kube-api-access-2h2ng\") pod \"bf3b00d3-3322-450e-94a0-8086264ddca2\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " Jul 23 18:48:20.282634 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.282590 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-trusted-ca-bundle\") pod \"bf3b00d3-3322-450e-94a0-8086264ddca2\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " Jul 23 18:48:20.282634 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.282607 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-serving-cert\") pod \"bf3b00d3-3322-450e-94a0-8086264ddca2\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " Jul 23 18:48:20.282634 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.282623 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-service-ca\") pod \"bf3b00d3-3322-450e-94a0-8086264ddca2\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " Jul 23 18:48:20.282945 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.282645 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-oauth-serving-cert\") pod \"bf3b00d3-3322-450e-94a0-8086264ddca2\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " Jul 23 18:48:20.282945 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.282738 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-oauth-config\") pod \"bf3b00d3-3322-450e-94a0-8086264ddca2\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " Jul 23 18:48:20.282945 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.282800 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-console-config\") pod \"bf3b00d3-3322-450e-94a0-8086264ddca2\" (UID: \"bf3b00d3-3322-450e-94a0-8086264ddca2\") " Jul 23 18:48:20.283099 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.283033 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bf3b00d3-3322-450e-94a0-8086264ddca2" (UID: "bf3b00d3-3322-450e-94a0-8086264ddca2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:20.283099 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.283042 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-service-ca" (OuterVolumeSpecName: "service-ca") pod "bf3b00d3-3322-450e-94a0-8086264ddca2" (UID: "bf3b00d3-3322-450e-94a0-8086264ddca2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:20.283099 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.283071 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bf3b00d3-3322-450e-94a0-8086264ddca2" (UID: "bf3b00d3-3322-450e-94a0-8086264ddca2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:20.283381 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.283355 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-console-config" (OuterVolumeSpecName: "console-config") pod "bf3b00d3-3322-450e-94a0-8086264ddca2" (UID: "bf3b00d3-3322-450e-94a0-8086264ddca2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:48:20.284905 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.284872 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bf3b00d3-3322-450e-94a0-8086264ddca2" (UID: "bf3b00d3-3322-450e-94a0-8086264ddca2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:48:20.284905 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.284888 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bf3b00d3-3322-450e-94a0-8086264ddca2" (UID: "bf3b00d3-3322-450e-94a0-8086264ddca2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:48:20.284905 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.284899 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf3b00d3-3322-450e-94a0-8086264ddca2-kube-api-access-2h2ng" (OuterVolumeSpecName: "kube-api-access-2h2ng") pod "bf3b00d3-3322-450e-94a0-8086264ddca2" (UID: "bf3b00d3-3322-450e-94a0-8086264ddca2"). InnerVolumeSpecName "kube-api-access-2h2ng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:48:20.383908 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.383873 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:20.383908 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.383901 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2h2ng\" (UniqueName: \"kubernetes.io/projected/bf3b00d3-3322-450e-94a0-8086264ddca2-kube-api-access-2h2ng\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:20.383908 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.383911 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:20.384145 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.383920 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:20.384145 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.383928 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:20.384145 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.383936 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf3b00d3-3322-450e-94a0-8086264ddca2-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:20.384145 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.383944 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf3b00d3-3322-450e-94a0-8086264ddca2-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:48:20.972384 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.972349 2563 generic.go:356] "Generic (PLEG): container finished" podID="bf3b00d3-3322-450e-94a0-8086264ddca2" containerID="1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0" exitCode=0 Jul 23 18:48:20.972862 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.972397 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8959ffbcf-v42h7" Jul 23 18:48:20.972862 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.972429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8959ffbcf-v42h7" event={"ID":"bf3b00d3-3322-450e-94a0-8086264ddca2","Type":"ContainerDied","Data":"1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0"} Jul 23 18:48:20.972862 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.972514 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8959ffbcf-v42h7" event={"ID":"bf3b00d3-3322-450e-94a0-8086264ddca2","Type":"ContainerDied","Data":"77be3999c21648a851d29e4518bda7eb6833af3d99aa4181fd3e262dd5baa1bd"} Jul 23 18:48:20.972862 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.972555 2563 scope.go:117] "RemoveContainer" containerID="1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0" Jul 23 18:48:20.981748 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.981729 2563 scope.go:117] "RemoveContainer" containerID="1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0" Jul 23 18:48:20.982009 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:48:20.981991 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0\": container with ID starting with 1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0 not found: ID does not exist" containerID="1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0" Jul 23 18:48:20.982048 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.982017 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0"} err="failed to get container status \"1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0\": rpc error: code = NotFound desc = could not find container \"1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0\": container with ID starting with 1b77eb1807cac93aa74917af6096ad1bfee15ba2b6226fa18c7927cc3b24f8d0 not found: ID does not exist" Jul 23 18:48:20.998285 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:20.998245 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8959ffbcf-v42h7"] Jul 23 18:48:21.003996 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:21.003955 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8959ffbcf-v42h7"] Jul 23 18:48:21.053964 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:21.053924 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf3b00d3-3322-450e-94a0-8086264ddca2" path="/var/lib/kubelet/pods/bf3b00d3-3322-450e-94a0-8086264ddca2/volumes" Jul 23 18:48:21.178654 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:21.178624 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:48:52.950629 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:52.950592 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:48:53.051636 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:48:53.051597 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:15.274737 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:15.274656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:15.646099 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:15.646069 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:19.578343 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:19.578307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:19.690698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:19.690661 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:21.327968 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:21.327928 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:21.592584 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:21.592492 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:21.714082 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:21.714031 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:23.656934 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:23.656898 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:23.922070 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:23.921976 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:24.090948 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.090919 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw"] Jul 23 18:49:24.091193 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.091182 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3b00d3-3322-450e-94a0-8086264ddca2" containerName="console" Jul 23 18:49:24.091253 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.091194 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3b00d3-3322-450e-94a0-8086264ddca2" containerName="console" Jul 23 18:49:24.091253 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.091216 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab884e7c-b465-4679-a209-b2bd99c03f33" containerName="console" Jul 23 18:49:24.091253 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.091221 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab884e7c-b465-4679-a209-b2bd99c03f33" containerName="console" Jul 23 18:49:24.091388 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.091276 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3b00d3-3322-450e-94a0-8086264ddca2" containerName="console" Jul 23 18:49:24.091388 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.091286 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab884e7c-b465-4679-a209-b2bd99c03f33" containerName="console" Jul 23 18:49:24.094215 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.094195 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.097324 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.097303 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s79h6\"" Jul 23 18:49:24.098285 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.098246 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 18:49:24.098396 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.098336 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 18:49:24.120857 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.120828 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw"] Jul 23 18:49:24.195925 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.195832 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thbl7\" (UniqueName: \"kubernetes.io/projected/e58c9fe2-e0f1-4430-9c82-a92ea714c858-kube-api-access-thbl7\") pod \"cert-manager-cainjector-559cdd8c87-l7fsw\" (UID: \"e58c9fe2-e0f1-4430-9c82-a92ea714c858\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.195925 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.195910 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e58c9fe2-e0f1-4430-9c82-a92ea714c858-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l7fsw\" (UID: \"e58c9fe2-e0f1-4430-9c82-a92ea714c858\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.296960 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.296919 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thbl7\" (UniqueName: \"kubernetes.io/projected/e58c9fe2-e0f1-4430-9c82-a92ea714c858-kube-api-access-thbl7\") pod \"cert-manager-cainjector-559cdd8c87-l7fsw\" (UID: \"e58c9fe2-e0f1-4430-9c82-a92ea714c858\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.297125 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.296998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e58c9fe2-e0f1-4430-9c82-a92ea714c858-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l7fsw\" (UID: \"e58c9fe2-e0f1-4430-9c82-a92ea714c858\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.306999 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.306958 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e58c9fe2-e0f1-4430-9c82-a92ea714c858-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l7fsw\" (UID: \"e58c9fe2-e0f1-4430-9c82-a92ea714c858\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.307121 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.307020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thbl7\" (UniqueName: \"kubernetes.io/projected/e58c9fe2-e0f1-4430-9c82-a92ea714c858-kube-api-access-thbl7\") pod \"cert-manager-cainjector-559cdd8c87-l7fsw\" (UID: \"e58c9fe2-e0f1-4430-9c82-a92ea714c858\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.414064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.414020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" Jul 23 18:49:24.545484 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:24.545451 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw"] Jul 23 18:49:24.549494 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:49:24.549465 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode58c9fe2_e0f1_4430_9c82_a92ea714c858.slice/crio-f0a609e48b1b4d5d197dcef0badfcb920586559a065e258773902efdd5e8bc62 WatchSource:0}: Error finding container f0a609e48b1b4d5d197dcef0badfcb920586559a065e258773902efdd5e8bc62: Status 404 returned error can't find the container with id f0a609e48b1b4d5d197dcef0badfcb920586559a065e258773902efdd5e8bc62 Jul 23 18:49:25.204622 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:25.204586 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" event={"ID":"e58c9fe2-e0f1-4430-9c82-a92ea714c858","Type":"ContainerStarted","Data":"f0a609e48b1b4d5d197dcef0badfcb920586559a065e258773902efdd5e8bc62"} Jul 23 18:49:26.728164 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:26.728131 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:26.837469 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:26.837416 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:28.185708 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:28.185677 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:28.219759 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:28.219726 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" event={"ID":"e58c9fe2-e0f1-4430-9c82-a92ea714c858","Type":"ContainerStarted","Data":"ed92eeda45b988f152179302a564fc089ceacf22f1bfb71300ef83bd05a201d1"} Jul 23 18:49:28.244944 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:28.244887 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l7fsw" podStartSLOduration=1.139963862 podStartE2EDuration="4.244871406s" totalImagesPullingTime="3.104907544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:49:28.243878048 +0000 UTC m=+285.705537102" watchObservedRunningTime="2026-07-23 18:49:28.244871406 +0000 UTC m=+285.706530457" Jul 23 18:49:30.879289 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:30.879233 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:33.200477 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:33.200443 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:33.292539 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:33.292499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:34.623489 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.623451 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx"] Jul 23 18:49:34.626465 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.626450 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:34.629240 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.629220 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 18:49:34.630069 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.630050 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:49:34.630148 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.630056 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-k89w2\"" Jul 23 18:49:34.638339 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.638316 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx"] Jul 23 18:49:34.683460 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.683430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/406c1833-e723-4cd0-9d4b-a32c9ae72531-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nbxtx\" (UID: \"406c1833-e723-4cd0-9d4b-a32c9ae72531\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:34.683629 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.683466 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pj6h\" (UniqueName: \"kubernetes.io/projected/406c1833-e723-4cd0-9d4b-a32c9ae72531-kube-api-access-7pj6h\") pod \"openshift-lws-operator-fd8ccff4c-nbxtx\" (UID: \"406c1833-e723-4cd0-9d4b-a32c9ae72531\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:34.784301 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.784245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/406c1833-e723-4cd0-9d4b-a32c9ae72531-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nbxtx\" (UID: \"406c1833-e723-4cd0-9d4b-a32c9ae72531\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:34.784301 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.784304 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pj6h\" (UniqueName: \"kubernetes.io/projected/406c1833-e723-4cd0-9d4b-a32c9ae72531-kube-api-access-7pj6h\") pod \"openshift-lws-operator-fd8ccff4c-nbxtx\" (UID: \"406c1833-e723-4cd0-9d4b-a32c9ae72531\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:34.784664 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.784645 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/406c1833-e723-4cd0-9d4b-a32c9ae72531-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nbxtx\" (UID: \"406c1833-e723-4cd0-9d4b-a32c9ae72531\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:34.795082 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.795048 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pj6h\" (UniqueName: \"kubernetes.io/projected/406c1833-e723-4cd0-9d4b-a32c9ae72531-kube-api-access-7pj6h\") pod \"openshift-lws-operator-fd8ccff4c-nbxtx\" (UID: \"406c1833-e723-4cd0-9d4b-a32c9ae72531\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:34.935565 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:34.935533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" Jul 23 18:49:35.080130 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:35.080108 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx"] Jul 23 18:49:35.082931 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:49:35.082907 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod406c1833_e723_4cd0_9d4b_a32c9ae72531.slice/crio-b5231a908787152f5f074d3c0c7134854b211ba30573d8e00e4748e14d09b1b8 WatchSource:0}: Error finding container b5231a908787152f5f074d3c0c7134854b211ba30573d8e00e4748e14d09b1b8: Status 404 returned error can't find the container with id b5231a908787152f5f074d3c0c7134854b211ba30573d8e00e4748e14d09b1b8 Jul 23 18:49:35.247078 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:35.246996 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" event={"ID":"406c1833-e723-4cd0-9d4b-a32c9ae72531","Type":"ContainerStarted","Data":"b5231a908787152f5f074d3c0c7134854b211ba30573d8e00e4748e14d09b1b8"} Jul 23 18:49:38.260759 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:38.260719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" event={"ID":"406c1833-e723-4cd0-9d4b-a32c9ae72531","Type":"ContainerStarted","Data":"e77682102a284e6dd57d5a741ccc990702f234e89644849de8d0699d24e7604c"} Jul 23 18:49:38.282587 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:38.282534 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nbxtx" podStartSLOduration=1.8182591000000001 podStartE2EDuration="4.282519489s" totalImagesPullingTime="2.464260389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:49:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:49:38.281321013 +0000 UTC m=+295.742980065" watchObservedRunningTime="2026-07-23 18:49:38.282519489 +0000 UTC m=+295.744178543" Jul 23 18:49:39.046788 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:39.046747 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:39.150654 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:39.150624 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:41.034222 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:41.034183 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:42.897707 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:42.897682 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:49:42.903223 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:42.903201 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:49:42.905511 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:42.905490 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 18:49:44.902046 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:44.902006 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:45.001391 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:45.001365 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:53.122892 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:53.122852 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:53.220676 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:53.220633 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:53.763346 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:53.763310 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:54.156251 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.156209 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:54.258398 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.258357 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:54.333701 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.333668 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm"] Jul 23 18:49:54.336820 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.336800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.340803 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.340784 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 18:49:54.340920 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.340905 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 18:49:54.341105 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.341090 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 18:49:54.341182 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.341156 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lh4qb\"" Jul 23 18:49:54.341458 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.341443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 18:49:54.363727 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.363700 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm"] Jul 23 18:49:54.448095 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.447999 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.448095 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.448038 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7d4\" (UniqueName: \"kubernetes.io/projected/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-kube-api-access-2j7d4\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.448337 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.448165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-tmp\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.448337 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.448192 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.448337 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.448225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-manifests\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.519594 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.519556 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:54.549599 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.549569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-tmp\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.549599 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.549600 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.549861 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.549624 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-manifests\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.549861 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.549654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.549861 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.549676 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7d4\" (UniqueName: \"kubernetes.io/projected/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-kube-api-access-2j7d4\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.550255 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.550228 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-manifests\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.552747 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.552719 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-tmp\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.552870 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.552717 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.552940 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.552919 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-webhook-cert\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.572486 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.572454 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7d4\" (UniqueName: \"kubernetes.io/projected/1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5-kube-api-access-2j7d4\") pod \"opendatahub-operator-controller-manager-866667c7dc-tj9lm\" (UID: \"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5\") " pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.626669 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.626638 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:54.647571 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.647538 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:49:54.727904 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.727863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:54.818867 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.818835 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm"] Jul 23 18:49:54.819061 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:49:54.819040 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a951f6c_45a4_4b47_bbb8_3e97b0f5adf5.slice/crio-550579e014ea3eda4adadc29fc6636ae9042f0f4fe742cd2bd11a658b4455014 WatchSource:0}: Error finding container 550579e014ea3eda4adadc29fc6636ae9042f0f4fe742cd2bd11a658b4455014: Status 404 returned error can't find the container with id 550579e014ea3eda4adadc29fc6636ae9042f0f4fe742cd2bd11a658b4455014 Jul 23 18:49:54.820870 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.820853 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:49:54.866614 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:54.866576 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:55.030959 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:55.030874 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:55.266392 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:55.266362 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:49:55.327794 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:55.327713 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" event={"ID":"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5","Type":"ContainerStarted","Data":"550579e014ea3eda4adadc29fc6636ae9042f0f4fe742cd2bd11a658b4455014"} Jul 23 18:49:58.343517 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:58.343439 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" event={"ID":"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5","Type":"ContainerStarted","Data":"f795a4037d61fc25b2b08feba6fe001433f9db951e890369f0234f69986f5543"} Jul 23 18:49:59.349382 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:59.349288 2563 generic.go:356] "Generic (PLEG): container finished" podID="1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5" containerID="f795a4037d61fc25b2b08feba6fe001433f9db951e890369f0234f69986f5543" exitCode=0 Jul 23 18:49:59.349382 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:49:59.349356 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" event={"ID":"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5","Type":"ContainerDied","Data":"f795a4037d61fc25b2b08feba6fe001433f9db951e890369f0234f69986f5543"} Jul 23 18:50:00.357354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:00.357316 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" event={"ID":"1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5","Type":"ContainerStarted","Data":"b3c6eb5b9010746b7ae2bed1bd70f1bf6e6ed8fb5f213b14b6b06a43bddc7386"} Jul 23 18:50:00.357772 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:00.357467 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:50:00.395000 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:00.394945 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" podStartSLOduration=1.851931623 podStartE2EDuration="6.394927638s" totalImagesPullingTime="3.455561428s" totalInitContainerRuntime="1.087434587s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:49:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:50:00.393084368 +0000 UTC m=+317.854743421" watchObservedRunningTime="2026-07-23 18:50:00.394927638 +0000 UTC m=+317.856586689" Jul 23 18:50:02.626315 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:02.626226 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:02.724570 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:02.724509 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:11.363590 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:11.363561 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-866667c7dc-tj9lm" Jul 23 18:50:12.142770 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:12.142737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:12.219504 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:12.219470 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:13.680118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:13.680076 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:13.827509 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:13.827474 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:14.547501 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:14.547456 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:14.660064 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:14.660016 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:14.767478 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:14.767442 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:14.869319 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:14.869191 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:15.388086 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:15.388046 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:15.937603 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:15.937573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:21.944309 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.944254 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r"] Jul 23 18:50:21.952313 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.952291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:21.957505 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.957482 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6kxtc\"" Jul 23 18:50:21.957894 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.957858 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 18:50:21.958009 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.957914 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 18:50:21.958009 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.957959 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 18:50:21.964289 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.964245 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r"] Jul 23 18:50:21.993005 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.992972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/226c996e-a887-4947-8f9f-f9153d609dc6-metrics-cert\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:21.993186 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.993025 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/226c996e-a887-4947-8f9f-f9153d609dc6-manager-config\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:21.993186 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.993078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc9dx\" (UniqueName: \"kubernetes.io/projected/226c996e-a887-4947-8f9f-f9153d609dc6-kube-api-access-sc9dx\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:21.993186 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:21.993100 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/226c996e-a887-4947-8f9f-f9153d609dc6-cert\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.094335 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.094293 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/226c996e-a887-4947-8f9f-f9153d609dc6-metrics-cert\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.094525 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.094345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/226c996e-a887-4947-8f9f-f9153d609dc6-manager-config\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.094589 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.094519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc9dx\" (UniqueName: \"kubernetes.io/projected/226c996e-a887-4947-8f9f-f9153d609dc6-kube-api-access-sc9dx\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.094589 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.094555 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/226c996e-a887-4947-8f9f-f9153d609dc6-cert\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.095065 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.095043 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/226c996e-a887-4947-8f9f-f9153d609dc6-manager-config\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.096941 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.096915 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/226c996e-a887-4947-8f9f-f9153d609dc6-metrics-cert\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.097082 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.097061 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/226c996e-a887-4947-8f9f-f9153d609dc6-cert\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.109507 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.109478 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc9dx\" (UniqueName: \"kubernetes.io/projected/226c996e-a887-4947-8f9f-f9153d609dc6-kube-api-access-sc9dx\") pod \"lws-controller-manager-5cb69776b7-72m4r\" (UID: \"226c996e-a887-4947-8f9f-f9153d609dc6\") " pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.261751 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.261665 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:22.404151 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.404127 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r"] Jul 23 18:50:22.406637 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:50:22.406609 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226c996e_a887_4947_8f9f_f9153d609dc6.slice/crio-40a8b3b937267f70f675a6b1c082e06ff1f79d953997ebb8455777b4617efc72 WatchSource:0}: Error finding container 40a8b3b937267f70f675a6b1c082e06ff1f79d953997ebb8455777b4617efc72: Status 404 returned error can't find the container with id 40a8b3b937267f70f675a6b1c082e06ff1f79d953997ebb8455777b4617efc72 Jul 23 18:50:22.450820 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:22.450781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" event={"ID":"226c996e-a887-4947-8f9f-f9153d609dc6","Type":"ContainerStarted","Data":"40a8b3b937267f70f675a6b1c082e06ff1f79d953997ebb8455777b4617efc72"} Jul 23 18:50:24.460882 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:24.460847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" event={"ID":"226c996e-a887-4947-8f9f-f9153d609dc6","Type":"ContainerStarted","Data":"ce940d0835b71dd86c07aac10617339f63c19f2d4579ff58584bedd90a8bc985"} Jul 23 18:50:24.461332 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:24.460964 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:24.488132 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:24.488075 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" podStartSLOduration=1.814993931 podStartE2EDuration="3.48805269s" totalImagesPullingTime="1.673058759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:50:24.485892231 +0000 UTC m=+341.947551272" watchObservedRunningTime="2026-07-23 18:50:24.48805269 +0000 UTC m=+341.949711753" Jul 23 18:50:25.173030 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.172997 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:25.195070 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.195039 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5"] Jul 23 18:50:25.198411 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.198387 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.203033 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.203007 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 18:50:25.204081 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.204016 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 18:50:25.204218 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.204097 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c9cnl\"" Jul 23 18:50:25.204218 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.204098 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 18:50:25.204218 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.204198 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 18:50:25.222777 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.222746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8v98\" (UniqueName: \"kubernetes.io/projected/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-kube-api-access-t8v98\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.222882 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.222784 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-tmp\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.222882 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.222815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-tls-certs\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.230808 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.230782 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5"] Jul 23 18:50:25.323776 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.323743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8v98\" (UniqueName: \"kubernetes.io/projected/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-kube-api-access-t8v98\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.323958 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.323785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-tmp\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.323958 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.323806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-tls-certs\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.326247 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.326222 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-tmp\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.326517 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.326496 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-tls-certs\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.351201 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.351169 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:25.352454 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.352436 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8v98\" (UniqueName: \"kubernetes.io/projected/d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d-kube-api-access-t8v98\") pod \"kube-auth-proxy-5f9fb8f558-hjhd5\" (UID: \"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d\") " pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.508935 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.508841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" Jul 23 18:50:25.714446 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.714416 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5"] Jul 23 18:50:25.717507 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:50:25.717475 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cb8c5c_ba3f_4e31_92ae_31b224af8f4d.slice/crio-1db5cb92ef6136f299aa398a96cb784e798f102bfec819111584805fa24ef2d6 WatchSource:0}: Error finding container 1db5cb92ef6136f299aa398a96cb784e798f102bfec819111584805fa24ef2d6: Status 404 returned error can't find the container with id 1db5cb92ef6136f299aa398a96cb784e798f102bfec819111584805fa24ef2d6 Jul 23 18:50:25.885296 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:25.885247 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:26.057760 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:26.057728 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:26.161563 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:26.161480 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:26.326234 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:26.326192 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:26.471517 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:26.471436 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" event={"ID":"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d","Type":"ContainerStarted","Data":"1db5cb92ef6136f299aa398a96cb784e798f102bfec819111584805fa24ef2d6"} Jul 23 18:50:28.262897 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:28.262866 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:28.500475 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:28.500436 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:28.618720 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:28.618651 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:29.492892 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:29.492856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" event={"ID":"d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d","Type":"ContainerStarted","Data":"2842f899f6ca241111b555135128b1b99a134f9acbd27d3aac91157e1eb1005d"} Jul 23 18:50:29.524771 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:29.524719 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f9fb8f558-hjhd5" podStartSLOduration=1.573322506 podStartE2EDuration="4.524703811s" totalImagesPullingTime="2.951381305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:50:29.522499219 +0000 UTC m=+346.984158271" watchObservedRunningTime="2026-07-23 18:50:29.524703811 +0000 UTC m=+346.986362862" Jul 23 18:50:30.259066 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:30.259027 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:33.594698 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:33.594601 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:33.755336 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:33.755301 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:33.955051 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:33.955016 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:34.220713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:34.220631 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:34.539714 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:34.539627 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:35.467105 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:35.467078 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cb69776b7-72m4r" Jul 23 18:50:37.746164 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:37.746123 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:50:37.848285 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:50:37.848239 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:15.281138 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:15.281101 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:15.401393 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:15.401359 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:15.548422 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:15.548329 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:38.257768 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:38.257734 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:41.925185 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:41.925143 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:42.224189 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:42.224111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:46.645142 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:46.645107 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:47.067650 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:47.067571 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:48.565705 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:48.565665 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:49.091475 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.091440 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cxx84"] Jul 23 18:51:49.094618 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.094604 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" Jul 23 18:51:49.101522 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.101498 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-ghzq9\"" Jul 23 18:51:49.101644 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.101539 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 18:51:49.101644 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.101545 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 18:51:49.118929 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.118901 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cxx84"] Jul 23 18:51:49.255623 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.255580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpwpk\" (UniqueName: \"kubernetes.io/projected/a854a53a-f653-45b6-94d5-d1915dcc70e3-kube-api-access-fpwpk\") pod \"authorino-operator-75cc8d5cb7-cxx84\" (UID: \"a854a53a-f653-45b6-94d5-d1915dcc70e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" Jul 23 18:51:49.356107 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.356021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpwpk\" (UniqueName: \"kubernetes.io/projected/a854a53a-f653-45b6-94d5-d1915dcc70e3-kube-api-access-fpwpk\") pod \"authorino-operator-75cc8d5cb7-cxx84\" (UID: \"a854a53a-f653-45b6-94d5-d1915dcc70e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" Jul 23 18:51:49.367072 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.367047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpwpk\" (UniqueName: \"kubernetes.io/projected/a854a53a-f653-45b6-94d5-d1915dcc70e3-kube-api-access-fpwpk\") pod \"authorino-operator-75cc8d5cb7-cxx84\" (UID: \"a854a53a-f653-45b6-94d5-d1915dcc70e3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" Jul 23 18:51:49.404038 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.404005 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" Jul 23 18:51:49.543448 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.543423 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-cxx84"] Jul 23 18:51:49.546205 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:51:49.546181 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda854a53a_f653_45b6_94d5_d1915dcc70e3.slice/crio-fa0f4c04523f8a2bb27572ce76021c90a4032c716cdfa5e6e2262328caf69214 WatchSource:0}: Error finding container fa0f4c04523f8a2bb27572ce76021c90a4032c716cdfa5e6e2262328caf69214: Status 404 returned error can't find the container with id fa0f4c04523f8a2bb27572ce76021c90a4032c716cdfa5e6e2262328caf69214 Jul 23 18:51:49.830363 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:49.830314 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" event={"ID":"a854a53a-f653-45b6-94d5-d1915dcc70e3","Type":"ContainerStarted","Data":"fa0f4c04523f8a2bb27572ce76021c90a4032c716cdfa5e6e2262328caf69214"} Jul 23 18:51:50.109772 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:50.109680 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:51.015003 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:51.014967 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:51.166741 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:51.166685 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:52.847420 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:52.847387 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" event={"ID":"a854a53a-f653-45b6-94d5-d1915dcc70e3","Type":"ContainerStarted","Data":"f0f03dabfcc10ffc1b4f5cc9f8e8121534863d3754e51b218288c0888a56ea17"} Jul 23 18:51:52.847913 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:52.847523 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" Jul 23 18:51:52.877492 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:52.877439 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" podStartSLOduration=1.391667896 podStartE2EDuration="3.877419248s" totalImagesPullingTime="2.485751352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:51:52.876609873 +0000 UTC m=+430.338268924" watchObservedRunningTime="2026-07-23 18:51:52.877419248 +0000 UTC m=+430.339078298" Jul 23 18:51:52.961690 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:52.961661 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:54.293212 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:54.293170 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:54.403381 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:54.403328 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:55.552096 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:55.552057 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:55.709250 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:55.709185 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:57.869459 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:57.869413 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:51:57.954148 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:51:57.954118 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:03.853917 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:03.853843 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-cxx84" Jul 23 18:52:06.550001 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:06.549958 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:06.702985 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:06.702953 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:06.829719 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:06.829624 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:06.965772 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:06.965738 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:08.790507 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:08.790466 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:08.906154 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:08.906115 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:13.129084 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:13.129051 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:13.293751 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:13.293717 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:15.327092 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:15.327055 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:15.421756 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:15.421720 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:23.690051 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:23.690007 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:24.213354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:24.213318 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:24.313481 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:24.313438 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:26.827199 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:26.827162 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:26.996566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:26.996518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:31.192097 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:31.192064 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:31.333989 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:31.333959 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:33.966040 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:33.965997 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:34.104308 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:34.104251 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:41.221183 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:41.221144 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:41.532454 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:41.532373 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:43.321389 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.321356 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:43.431157 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.431129 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:43.512956 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.512926 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:52:43.515134 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.515115 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.517830 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.517808 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 18:52:43.517958 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.517864 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-84rjw\"" Jul 23 18:52:43.532247 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.532217 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:52:43.533849 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.533816 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a675fb48-6761-4b2d-9099-aaec1a6c7034-config-file\") pod \"limitador-limitador-54d6d988d5-7dg6w\" (UID: \"a675fb48-6761-4b2d-9099-aaec1a6c7034\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.533981 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.533858 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpz5n\" (UniqueName: \"kubernetes.io/projected/a675fb48-6761-4b2d-9099-aaec1a6c7034-kube-api-access-jpz5n\") pod \"limitador-limitador-54d6d988d5-7dg6w\" (UID: \"a675fb48-6761-4b2d-9099-aaec1a6c7034\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.539083 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.539056 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:43.554281 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.554239 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:52:43.634798 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.634771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a675fb48-6761-4b2d-9099-aaec1a6c7034-config-file\") pod \"limitador-limitador-54d6d988d5-7dg6w\" (UID: \"a675fb48-6761-4b2d-9099-aaec1a6c7034\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.634959 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.634806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpz5n\" (UniqueName: \"kubernetes.io/projected/a675fb48-6761-4b2d-9099-aaec1a6c7034-kube-api-access-jpz5n\") pod \"limitador-limitador-54d6d988d5-7dg6w\" (UID: \"a675fb48-6761-4b2d-9099-aaec1a6c7034\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.635401 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.635383 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a675fb48-6761-4b2d-9099-aaec1a6c7034-config-file\") pod \"limitador-limitador-54d6d988d5-7dg6w\" (UID: \"a675fb48-6761-4b2d-9099-aaec1a6c7034\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.647532 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.647497 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpz5n\" (UniqueName: \"kubernetes.io/projected/a675fb48-6761-4b2d-9099-aaec1a6c7034-kube-api-access-jpz5n\") pod \"limitador-limitador-54d6d988d5-7dg6w\" (UID: \"a675fb48-6761-4b2d-9099-aaec1a6c7034\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.648976 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.648949 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:43.790141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.790108 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:43.826100 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.826066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:43.894024 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.893917 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:43.966214 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:43.966184 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:52:43.969016 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:52:43.968992 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda675fb48_6761_4b2d_9099_aaec1a6c7034.slice/crio-0a05a6fb2408686fe7102745728fc967a8d9cc30e7e1ef2d5e4cfbc59a816b46 WatchSource:0}: Error finding container 0a05a6fb2408686fe7102745728fc967a8d9cc30e7e1ef2d5e4cfbc59a816b46: Status 404 returned error can't find the container with id 0a05a6fb2408686fe7102745728fc967a8d9cc30e7e1ef2d5e4cfbc59a816b46 Jul 23 18:52:44.051453 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.051414 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:44.062709 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.062681 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" event={"ID":"a675fb48-6761-4b2d-9099-aaec1a6c7034","Type":"ContainerStarted","Data":"0a05a6fb2408686fe7102745728fc967a8d9cc30e7e1ef2d5e4cfbc59a816b46"} Jul 23 18:52:44.324744 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.324634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:44.553418 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.553362 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:44.720851 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.720800 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-92j9p"] Jul 23 18:52:44.723607 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.723580 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92j9p" Jul 23 18:52:44.730468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.730444 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dn5cx\"" Jul 23 18:52:44.743209 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.742733 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92j9p"] Jul 23 18:52:44.743209 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.743049 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvvkl\" (UniqueName: \"kubernetes.io/projected/ac21d516-ead6-4e05-8874-c730f683a34f-kube-api-access-cvvkl\") pod \"authorino-75d556bd77-92j9p\" (UID: \"ac21d516-ead6-4e05-8874-c730f683a34f\") " pod="kuadrant-system/authorino-75d556bd77-92j9p" Jul 23 18:52:44.844032 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.843982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvvkl\" (UniqueName: \"kubernetes.io/projected/ac21d516-ead6-4e05-8874-c730f683a34f-kube-api-access-cvvkl\") pod \"authorino-75d556bd77-92j9p\" (UID: \"ac21d516-ead6-4e05-8874-c730f683a34f\") " pod="kuadrant-system/authorino-75d556bd77-92j9p" Jul 23 18:52:44.872238 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:44.872200 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvvkl\" (UniqueName: \"kubernetes.io/projected/ac21d516-ead6-4e05-8874-c730f683a34f-kube-api-access-cvvkl\") pod \"authorino-75d556bd77-92j9p\" (UID: \"ac21d516-ead6-4e05-8874-c730f683a34f\") " pod="kuadrant-system/authorino-75d556bd77-92j9p" Jul 23 18:52:45.037027 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:45.036945 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92j9p" Jul 23 18:52:45.198947 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:45.198917 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92j9p"] Jul 23 18:52:45.439077 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:45.439042 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:45.546144 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:45.546108 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:52:45.962421 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:52:45.962391 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac21d516_ead6_4e05_8874_c730f683a34f.slice/crio-01ba8096384a59c16da67eb28d9758a5473e1c1dc12450b50b4bb06ec7930dd9 WatchSource:0}: Error finding container 01ba8096384a59c16da67eb28d9758a5473e1c1dc12450b50b4bb06ec7930dd9: Status 404 returned error can't find the container with id 01ba8096384a59c16da67eb28d9758a5473e1c1dc12450b50b4bb06ec7930dd9 Jul 23 18:52:46.074237 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:46.074206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92j9p" event={"ID":"ac21d516-ead6-4e05-8874-c730f683a34f","Type":"ContainerStarted","Data":"01ba8096384a59c16da67eb28d9758a5473e1c1dc12450b50b4bb06ec7930dd9"} Jul 23 18:52:47.082145 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:47.082107 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" event={"ID":"a675fb48-6761-4b2d-9099-aaec1a6c7034","Type":"ContainerStarted","Data":"7479fe9d2bde8e92222f4781f1ccec43d26dcaafcc6a3f846159bd69fc37848c"} Jul 23 18:52:47.082899 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:47.082872 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:52:47.145589 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:47.145526 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" podStartSLOduration=1.6267721819999998 podStartE2EDuration="4.145504117s" totalImagesPullingTime="2.518731935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:52:47.14384875 +0000 UTC m=+484.605507804" watchObservedRunningTime="2026-07-23 18:52:47.145504117 +0000 UTC m=+484.607163174" Jul 23 18:52:50.097484 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:50.097445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92j9p" event={"ID":"ac21d516-ead6-4e05-8874-c730f683a34f","Type":"ContainerStarted","Data":"549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692"} Jul 23 18:52:50.117362 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:50.117302 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-92j9p" podStartSLOduration=2.985106595 podStartE2EDuration="6.117251933s" totalImagesPullingTime="3.132145338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:52:50.116052678 +0000 UTC m=+487.577711730" watchObservedRunningTime="2026-07-23 18:52:50.117251933 +0000 UTC m=+487.578910986" Jul 23 18:52:59.093671 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:52:59.093642 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-7dg6w" Jul 23 18:53:04.689667 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:04.689628 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:04.809056 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:04.809021 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:05.229448 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:05.229408 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:17.788862 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:17.788807 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:18.179981 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:18.179943 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:20.450181 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:20.450148 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92j9p"] Jul 23 18:53:20.450602 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:20.450359 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-92j9p" podUID="ac21d516-ead6-4e05-8874-c730f683a34f" containerName="authorino" containerID="cri-o://549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692" gracePeriod=30 Jul 23 18:53:20.688843 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:20.688818 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92j9p" Jul 23 18:53:20.778118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:20.778037 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvvkl\" (UniqueName: \"kubernetes.io/projected/ac21d516-ead6-4e05-8874-c730f683a34f-kube-api-access-cvvkl\") pod \"ac21d516-ead6-4e05-8874-c730f683a34f\" (UID: \"ac21d516-ead6-4e05-8874-c730f683a34f\") " Jul 23 18:53:20.780734 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:20.780696 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac21d516-ead6-4e05-8874-c730f683a34f-kube-api-access-cvvkl" (OuterVolumeSpecName: "kube-api-access-cvvkl") pod "ac21d516-ead6-4e05-8874-c730f683a34f" (UID: "ac21d516-ead6-4e05-8874-c730f683a34f"). InnerVolumeSpecName "kube-api-access-cvvkl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:53:20.879604 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:20.879564 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvvkl\" (UniqueName: \"kubernetes.io/projected/ac21d516-ead6-4e05-8874-c730f683a34f-kube-api-access-cvvkl\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\"" Jul 23 18:53:21.235498 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.235458 2563 generic.go:356] "Generic (PLEG): container finished" podID="ac21d516-ead6-4e05-8874-c730f683a34f" containerID="549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692" exitCode=0 Jul 23 18:53:21.235672 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.235503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92j9p" event={"ID":"ac21d516-ead6-4e05-8874-c730f683a34f","Type":"ContainerDied","Data":"549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692"} Jul 23 18:53:21.235672 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.235548 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-92j9p" event={"ID":"ac21d516-ead6-4e05-8874-c730f683a34f","Type":"ContainerDied","Data":"01ba8096384a59c16da67eb28d9758a5473e1c1dc12450b50b4bb06ec7930dd9"} Jul 23 18:53:21.235672 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.235568 2563 scope.go:117] "RemoveContainer" containerID="549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692" Jul 23 18:53:21.235672 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.235519 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-92j9p" Jul 23 18:53:21.244380 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.244359 2563 scope.go:117] "RemoveContainer" containerID="549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692" Jul 23 18:53:21.244650 ip-10-0-129-12 kubenswrapper[2563]: E0723 18:53:21.244631 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692\": container with ID starting with 549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692 not found: ID does not exist" containerID="549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692" Jul 23 18:53:21.244705 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.244659 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692"} err="failed to get container status \"549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692\": rpc error: code = NotFound desc = could not find container \"549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692\": container with ID starting with 549ced8e1ef902f1b3155ee987a22d9cc64ca689917739181e437891096ab692 not found: ID does not exist" Jul 23 18:53:21.283406 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.283362 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92j9p"] Jul 23 18:53:21.303536 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:21.303505 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-92j9p"] Jul 23 18:53:23.054696 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:23.054652 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac21d516-ead6-4e05-8874-c730f683a34f" path="/var/lib/kubelet/pods/ac21d516-ead6-4e05-8874-c730f683a34f/volumes" Jul 23 18:53:24.548696 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:24.548656 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:25.655384 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:25.655356 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:25.827518 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:25.827483 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:26.059406 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:26.059300 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:26.162143 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:26.162106 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:28.938764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:28.938725 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:29.117236 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:29.117195 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:33.910420 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:33.910333 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:55.235576 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:55.235535 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:53:55.338999 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:53:55.338960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:03.596661 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:03.596621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:03.740126 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:03.740089 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:04.206764 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:04.206736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:04.489934 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:04.489845 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:05.615997 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:05.615966 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:05.791331 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:05.791294 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:06.186352 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:06.186319 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:54:10.375236 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:10.375195 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:10.499988 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:10.499953 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:14.107669 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:14.107632 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:14.403016 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:14.402979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:33.714932 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:33.714889 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:34.228810 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:34.228773 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:54:39.944386 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:39.944325 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:42.931554 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:42.931526 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:54:42.932366 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:42.932342 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-26p9d_034c9bbb-b208-49f1-bbe4-6d4675c43405/ovn-acl-logging/0.log" Jul 23 18:54:50.130446 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:50.130404 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:54.521022 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:54.520987 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:54:55.441118 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:55.441079 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:54:59.850467 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:54:59.850427 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:55:01.037308 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:01.036345 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:55:05.137047 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.136961 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf"] Jul 23 18:55:05.137455 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.137284 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac21d516-ead6-4e05-8874-c730f683a34f" containerName="authorino" Jul 23 18:55:05.137455 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.137296 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac21d516-ead6-4e05-8874-c730f683a34f" containerName="authorino" Jul 23 18:55:05.137455 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.137371 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac21d516-ead6-4e05-8874-c730f683a34f" containerName="authorino" Jul 23 18:55:05.139227 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.139211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.148021 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.148001 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 18:55:05.149144 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.149123 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mqzqs\"" Jul 23 18:55:05.149144 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.149135 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 18:55:05.149327 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.149119 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 23 18:55:05.164679 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.164649 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf"] Jul 23 18:55:05.212471 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.212435 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:55:05.261386 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.261355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btp27\" (UniqueName: \"kubernetes.io/projected/95a5a0a9-a899-4852-b9de-ac997c2720b2-kube-api-access-btp27\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.261586 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.261429 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.261586 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.261455 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.261586 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.261476 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.261586 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.261496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a5a0a9-a899-4852-b9de-ac997c2720b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.261586 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.261552 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362350 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362314 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362465 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a5a0a9-a899-4852-b9de-ac997c2720b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362566 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362550 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btp27\" (UniqueName: \"kubernetes.io/projected/95a5a0a9-a899-4852-b9de-ac997c2720b2-kube-api-access-btp27\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362822 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362803 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362899 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362872 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.362967 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.362907 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.364768 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.364746 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95a5a0a9-a899-4852-b9de-ac997c2720b2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.365086 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.365069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95a5a0a9-a899-4852-b9de-ac997c2720b2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.372169 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.372146 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btp27\" (UniqueName: \"kubernetes.io/projected/95a5a0a9-a899-4852-b9de-ac997c2720b2-kube-api-access-btp27\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf\" (UID: \"95a5a0a9-a899-4852-b9de-ac997c2720b2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.449075 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.448975 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:05.585753 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.585720 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf"] Jul 23 18:55:05.592013 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.591986 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:55:05.692025 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:05.691991 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" event={"ID":"95a5a0a9-a899-4852-b9de-ac997c2720b2","Type":"ContainerStarted","Data":"7cff50a4b662352d52a752021ac287141ef18a1c5262311ae4bef0b442532032"} Jul 23 18:55:07.706391 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:07.706347 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" event={"ID":"95a5a0a9-a899-4852-b9de-ac997c2720b2","Type":"ContainerStarted","Data":"9b719618cb0ae3661a4f106223f211de4c149e9116419cef74b170e4e006feb3"} Jul 23 18:55:07.729120 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:07.729065 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" podStartSLOduration=1.589656717 podStartE2EDuration="2.729025295s" totalImagesPullingTime="1.139368578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:55:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:55:07.728240246 +0000 UTC m=+625.189899296" watchObservedRunningTime="2026-07-23 18:55:07.729025295 +0000 UTC m=+625.190684345" Jul 23 18:55:07.835037 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:07.835000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:55:15.086105 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:15.086057 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:55:15.449164 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:15.449103 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:15.449400 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:15.449189 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:15.461993 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:15.461963 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:15.753432 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:15.753336 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf" Jul 23 18:55:17.243676 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.243647 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf"] Jul 23 18:55:17.246037 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.246020 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.249060 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.249042 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 23 18:55:17.264387 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.264358 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf"] Jul 23 18:55:17.267206 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.267182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.267354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.267219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.267354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.267248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.267354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.267309 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.267354 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.267341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn2tb\" (UniqueName: \"kubernetes.io/projected/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-kube-api-access-nn2tb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.267522 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.267406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.307039 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.307000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:55:17.367875 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.367841 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn2tb\" (UniqueName: \"kubernetes.io/projected/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-kube-api-access-nn2tb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.367875 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.367881 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.368108 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.367923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.368108 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.367948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.368108 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.367976 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.368108 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.367993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.368445 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.368414 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.368570 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.368453 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.368570 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.368494 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.370458 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.370432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.370602 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.370587 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.378018 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.377991 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn2tb\" (UniqueName: \"kubernetes.io/projected/a22dca03-d2bb-4c67-94d3-cbf1ae79fa04-kube-api-access-nn2tb\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-ssddf\" (UID: \"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.554850 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.554761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:17.706723 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.706699 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf"] Jul 23 18:55:17.709080 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:55:17.709056 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda22dca03_d2bb_4c67_94d3_cbf1ae79fa04.slice/crio-54619f231eb4213770ebf4f05a0441626c528345ab7e0160c9bf209cc9e8a6cf WatchSource:0}: Error finding container 54619f231eb4213770ebf4f05a0441626c528345ab7e0160c9bf209cc9e8a6cf: Status 404 returned error can't find the container with id 54619f231eb4213770ebf4f05a0441626c528345ab7e0160c9bf209cc9e8a6cf Jul 23 18:55:17.751620 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:17.751585 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" event={"ID":"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04","Type":"ContainerStarted","Data":"54619f231eb4213770ebf4f05a0441626c528345ab7e0160c9bf209cc9e8a6cf"} Jul 23 18:55:18.029336 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:18.029299 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:55:18.757973 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:18.757937 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" event={"ID":"a22dca03-d2bb-4c67-94d3-cbf1ae79fa04","Type":"ContainerStarted","Data":"8755e6445ec7f6d0ab97aad11dc8abaefd14b3e29afae5ce53f5d8c6ec0fa192"} Jul 23 18:55:18.791657 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:18.791607 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" podStartSLOduration=1.617173269 podStartE2EDuration="1.791590108s" totalImagesPullingTime="174.416839ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:55:18.790938721 +0000 UTC m=+636.252597772" watchObservedRunningTime="2026-07-23 18:55:18.791590108 +0000 UTC m=+636.253249159" Jul 23 18:55:27.555141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:27.555100 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:27.555141 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:27.555146 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:27.567874 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:27.567847 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:27.811899 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:27.811802 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-ssddf" Jul 23 18:55:30.025907 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:55:30.025871 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-7dg6w"] Jul 23 18:56:38.360368 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:56:38.360289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:56:38.476922 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:56:38.476880 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:56:39.690635 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:56:39.690599 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:56:39.793778 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:56:39.793737 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:57:02.069279 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:02.069236 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-866667c7dc-tj9lm_1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5/copy-manifests/0.log" Jul 23 18:57:02.098592 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:02.098564 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-866667c7dc-tj9lm_1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5/manager/0.log" Jul 23 18:57:04.188261 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:04.188228 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cxx84_a854a53a-f653-45b6-94d5-d1915dcc70e3/manager/0.log" Jul 23 18:57:04.906627 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:04.906594 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7dg6w_a675fb48-6761-4b2d-9099-aaec1a6c7034/limitador/0.log" Jul 23 18:57:05.661610 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:05.661572 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9fb8f558-hjhd5_d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d/kube-auth-proxy/0.log" Jul 23 18:57:07.007041 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:07.007005 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmt8nf_95a5a0a9-a899-4852-b9de-ac997c2720b2/main/0.log" Jul 23 18:57:07.252225 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:07.252197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-ssddf_a22dca03-d2bb-4c67-94d3-cbf1ae79fa04/main/0.log" Jul 23 18:57:12.742433 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.742395 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pcl8s/must-gather-9frpf"] Jul 23 18:57:12.745805 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.745787 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:12.748164 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.748141 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pcl8s\"/\"kube-root-ca.crt\"" Jul 23 18:57:12.748666 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.748647 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pcl8s\"/\"default-dockercfg-77rnw\"" Jul 23 18:57:12.748775 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.748682 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pcl8s\"/\"openshift-service-ca.crt\"" Jul 23 18:57:12.756421 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.756397 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pcl8s/must-gather-9frpf"] Jul 23 18:57:12.772071 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.772020 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:57:12.894255 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.894221 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024 Jul 23 18:57:12.919904 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.919867 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df11b811-8c0e-4105-baec-98ccb9ff1c3f-must-gather-output\") pod \"must-gather-9frpf\" (UID: \"df11b811-8c0e-4105-baec-98ccb9ff1c3f\") " pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:12.920051 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:12.919936 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vrzt\" (UniqueName: \"kubernetes.io/projected/df11b811-8c0e-4105-baec-98ccb9ff1c3f-kube-api-access-4vrzt\") pod \"must-gather-9frpf\" (UID: \"df11b811-8c0e-4105-baec-98ccb9ff1c3f\") " pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:13.020820 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:13.020724 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df11b811-8c0e-4105-baec-98ccb9ff1c3f-must-gather-output\") pod \"must-gather-9frpf\" (UID: \"df11b811-8c0e-4105-baec-98ccb9ff1c3f\") " pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:13.020820 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:13.020806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vrzt\" (UniqueName: \"kubernetes.io/projected/df11b811-8c0e-4105-baec-98ccb9ff1c3f-kube-api-access-4vrzt\") pod \"must-gather-9frpf\" (UID: \"df11b811-8c0e-4105-baec-98ccb9ff1c3f\") " pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:13.021063 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:13.021043 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df11b811-8c0e-4105-baec-98ccb9ff1c3f-must-gather-output\") pod \"must-gather-9frpf\" (UID: \"df11b811-8c0e-4105-baec-98ccb9ff1c3f\") " pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:13.057429 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:13.057404 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vrzt\" (UniqueName: \"kubernetes.io/projected/df11b811-8c0e-4105-baec-98ccb9ff1c3f-kube-api-access-4vrzt\") pod \"must-gather-9frpf\" (UID: \"df11b811-8c0e-4105-baec-98ccb9ff1c3f\") " pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:13.354958 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:13.354856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pcl8s/must-gather-9frpf" Jul 23 18:57:13.492630 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:13.492596 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pcl8s/must-gather-9frpf"] Jul 23 18:57:13.495387 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:57:13.495362 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf11b811_8c0e_4105_baec_98ccb9ff1c3f.slice/crio-eaed706672bcb2bf9fe671290b4083837a5744b9d18f73c5c37f62177b9fa254 WatchSource:0}: Error finding container eaed706672bcb2bf9fe671290b4083837a5744b9d18f73c5c37f62177b9fa254: Status 404 returned error can't find the container with id eaed706672bcb2bf9fe671290b4083837a5744b9d18f73c5c37f62177b9fa254 Jul 23 18:57:14.275070 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:14.275037 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pcl8s/must-gather-9frpf" event={"ID":"df11b811-8c0e-4105-baec-98ccb9ff1c3f","Type":"ContainerStarted","Data":"eaed706672bcb2bf9fe671290b4083837a5744b9d18f73c5c37f62177b9fa254"} Jul 23 18:57:15.282320 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:15.282258 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pcl8s/must-gather-9frpf" event={"ID":"df11b811-8c0e-4105-baec-98ccb9ff1c3f","Type":"ContainerStarted","Data":"df80445650252c8504fa9e8815435b974a4eb3f9a7bea07037b43cc266891153"} Jul 23 18:57:15.282811 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:15.282333 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pcl8s/must-gather-9frpf" event={"ID":"df11b811-8c0e-4105-baec-98ccb9ff1c3f","Type":"ContainerStarted","Data":"3a5bf14a741bc3106f6bb0eb9f1163a15a22b9c2c185dc83fd186a0c9f16f613"} Jul 23 18:57:16.246173 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:16.246146 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x84vd_e00077f0-0cf1-4564-8e70-03e238d3cc02/global-pull-secret-syncer/0.log" Jul 23 18:57:16.302870 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:16.302831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" Jul 23 18:57:16.411098 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:16.411060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-12.ec2.internal_e17e7656d483e4d3ef5e945c0f2ca874/haproxy/0.log" Jul 23 18:57:22.328686 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:22.328649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-cxx84_a854a53a-f653-45b6-94d5-d1915dcc70e3/manager/0.log" Jul 23 18:57:22.701157 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:22.701129 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-7dg6w_a675fb48-6761-4b2d-9099-aaec1a6c7034/limitador/0.log" Jul 23 18:57:24.284468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.284431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a155132e-5597-49b4-967d-889a4069e08c/alertmanager/0.log" Jul 23 18:57:24.352895 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.352839 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a155132e-5597-49b4-967d-889a4069e08c/config-reloader/0.log" Jul 23 18:57:24.411868 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.411830 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a155132e-5597-49b4-967d-889a4069e08c/kube-rbac-proxy-web/0.log" Jul 23 18:57:24.487837 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.487755 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a155132e-5597-49b4-967d-889a4069e08c/kube-rbac-proxy/0.log" Jul 23 18:57:24.527261 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.527229 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a155132e-5597-49b4-967d-889a4069e08c/kube-rbac-proxy-metric/0.log" Jul 23 18:57:24.571828 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.571801 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a155132e-5597-49b4-967d-889a4069e08c/prom-label-proxy/0.log" Jul 23 18:57:24.636383 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.636357 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a155132e-5597-49b4-967d-889a4069e08c/init-config-reloader/0.log" Jul 23 18:57:24.748004 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.747904 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r2nfd_d87da466-321d-4dcc-aa1f-5e321b2c25d9/kube-state-metrics/0.log" Jul 23 18:57:24.800232 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.800198 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r2nfd_d87da466-321d-4dcc-aa1f-5e321b2c25d9/kube-rbac-proxy-main/0.log" Jul 23 18:57:24.847546 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.847522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-r2nfd_d87da466-321d-4dcc-aa1f-5e321b2c25d9/kube-rbac-proxy-self/0.log" Jul 23 18:57:24.935313 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:24.935285 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-nxgdn_6abe7ad2-eb02-4de1-ac35-b8d29fde0598/monitoring-plugin/0.log" Jul 23 18:57:25.351591 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.351518 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj248_b354878e-798e-4e0f-be8c-0158bbe0627c/node-exporter/0.log" Jul 23 18:57:25.389523 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.389495 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj248_b354878e-798e-4e0f-be8c-0158bbe0627c/kube-rbac-proxy/0.log" Jul 23 18:57:25.438767 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.438739 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wj248_b354878e-798e-4e0f-be8c-0158bbe0627c/init-textfile/0.log" Jul 23 18:57:25.627260 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.627139 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57251b99-f14d-47a6-979d-3bd282fc8580/prometheus/0.log" Jul 23 18:57:25.674468 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.674440 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57251b99-f14d-47a6-979d-3bd282fc8580/config-reloader/0.log" Jul 23 18:57:25.715702 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.715627 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57251b99-f14d-47a6-979d-3bd282fc8580/thanos-sidecar/0.log" Jul 23 18:57:25.765640 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.765564 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57251b99-f14d-47a6-979d-3bd282fc8580/kube-rbac-proxy-web/0.log" Jul 23 18:57:25.839306 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.839253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57251b99-f14d-47a6-979d-3bd282fc8580/kube-rbac-proxy/0.log" Jul 23 18:57:25.897732 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.897700 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57251b99-f14d-47a6-979d-3bd282fc8580/kube-rbac-proxy-thanos/0.log" Jul 23 18:57:25.917456 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.917398 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pcl8s/must-gather-9frpf" podStartSLOduration=13.085046858 podStartE2EDuration="13.917374766s" totalImagesPullingTime="832.327908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:57:15.317202322 +0000 UTC m=+752.778861386" watchObservedRunningTime="2026-07-23 18:57:25.917374766 +0000 UTC m=+763.379033818" Jul 23 18:57:25.918937 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.918901 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9"] Jul 23 18:57:25.923473 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.923437 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:25.938823 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.938795 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9"] Jul 23 18:57:25.950430 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:25.950355 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_57251b99-f14d-47a6-979d-3bd282fc8580/init-config-reloader/0.log" Jul 23 18:57:26.062845 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.062808 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psltg\" (UniqueName: \"kubernetes.io/projected/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-kube-api-access-psltg\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.063120 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.063091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-podres\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.063249 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.063148 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-proc\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.063249 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.063189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-lib-modules\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.063249 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.063256 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-sys\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.068293 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.068237 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-xx5t6_f59b3e8a-d1c0-469f-935e-d7c9110c7b9d/prometheus-operator-admission-webhook/0.log" Jul 23 18:57:26.164619 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-lib-modules\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.164619 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164626 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-sys\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.164872 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164702 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psltg\" (UniqueName: \"kubernetes.io/projected/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-kube-api-access-psltg\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.164872 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164740 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-lib-modules\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.164872 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164771 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-sys\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.164872 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-podres\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.164872 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-proc\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.164872 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164840 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-podres\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.165159 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.164904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-proc\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.174713 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.174677 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psltg\" (UniqueName: \"kubernetes.io/projected/4df89f92-39ca-46f6-afd4-ab4e2d1de5f7-kube-api-access-psltg\") pod \"perf-node-gather-daemonset-f2pm9\" (UID: \"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7\") " pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.237833 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.237796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:26.412460 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:26.412426 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9"] Jul 23 18:57:26.413328 ip-10-0-129-12 kubenswrapper[2563]: W0723 18:57:26.413258 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4df89f92_39ca_46f6_afd4_ab4e2d1de5f7.slice/crio-f5440207a432f560dd09a6ec4d314c0794030681e50351ed1117d60c3e2866cc WatchSource:0}: Error finding container f5440207a432f560dd09a6ec4d314c0794030681e50351ed1117d60c3e2866cc: Status 404 returned error can't find the container with id f5440207a432f560dd09a6ec4d314c0794030681e50351ed1117d60c3e2866cc Jul 23 18:57:27.380039 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:27.379995 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" event={"ID":"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7","Type":"ContainerStarted","Data":"40205bb8e403ab2fa632374c2ef22adf2147c7fdb4bde0023c2f85751fce17b7"} Jul 23 18:57:27.380222 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:27.380064 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" event={"ID":"4df89f92-39ca-46f6-afd4-ab4e2d1de5f7","Type":"ContainerStarted","Data":"f5440207a432f560dd09a6ec4d314c0794030681e50351ed1117d60c3e2866cc"} Jul 23 18:57:27.380222 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:27.380110 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:27.407964 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:27.407896 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" podStartSLOduration=2.407870523 podStartE2EDuration="2.407870523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:57:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:57:27.402969934 +0000 UTC m=+764.864628986" watchObservedRunningTime="2026-07-23 18:57:27.407870523 +0000 UTC m=+764.869529575" Jul 23 18:57:28.793456 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:28.793420 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69cd46dc4d-ph7l5_0f0e2ea0-1f81-4bda-9c1d-f07a20565e27/console/0.log" Jul 23 18:57:30.931081 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:30.931050 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d5x2m_0d46ce75-2e0c-4aec-b65d-928b732e3388/dns/0.log" Jul 23 18:57:30.967646 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:30.967615 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d5x2m_0d46ce75-2e0c-4aec-b65d-928b732e3388/kube-rbac-proxy/0.log" Jul 23 18:57:31.155030 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:31.155004 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jhgx6_7ffcc121-2ee8-448d-a9e5-b0e08c47fa1f/dns-node-resolver/0.log" Jul 23 18:57:31.886779 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:31.884570 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tm9rb_89657ad4-1c6e-4e7c-b48d-e911162cd051/node-ca/0.log" Jul 23 18:57:33.100825 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:33.100795 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9fb8f558-hjhd5_d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d/kube-auth-proxy/0.log" Jul 23 18:57:33.395326 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:33.395300 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pcl8s/perf-node-gather-daemonset-f2pm9" Jul 23 18:57:33.972145 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:33.972120 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gx9s7_2ce92595-1253-445a-8342-4b596317c73f/serve-healthcheck-canary/0.log" Jul 23 18:57:34.795175 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:34.795132 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9c4f_f6752b02-c2f6-4e21-9684-ca39f89ebccd/kube-rbac-proxy/0.log" Jul 23 18:57:34.830532 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:34.830457 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9c4f_f6752b02-c2f6-4e21-9684-ca39f89ebccd/exporter/0.log" Jul 23 18:57:34.860918 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:34.860889 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9c4f_f6752b02-c2f6-4e21-9684-ca39f89ebccd/extractor/0.log" Jul 23 18:57:36.986533 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:36.986504 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9fb8f558-hjhd5_d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d/kube-auth-proxy/0.log" Jul 23 18:57:37.861413 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:37.861383 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-866667c7dc-tj9lm_1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5/manager/0.log" Jul 23 18:57:37.880508 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:37.880436 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-866667c7dc-tj9lm_1a951f6c-45a4-4b47-bbb8-3e97b0f5adf5/copy-manifests/0.log" Jul 23 18:57:38.247037 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:38.247008 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f9fb8f558-hjhd5_d3cb8c5c-ba3f-4e31-92ae-31b224af8f4d/kube-auth-proxy/0.log" Jul 23 18:57:39.069077 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:39.069044 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cb69776b7-72m4r_226c996e-a887-4947-8f9f-f9153d609dc6/manager/0.log" Jul 23 18:57:39.138180 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:39.138148 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nbxtx_406c1833-e723-4cd0-9d4b-a32c9ae72531/openshift-lws-operator/0.log" Jul 23 18:57:41.178466 ip-10-0-129-12 kubenswrapper[2563]: I0723 18:57:41.178431 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rrgpm_45f63750-cea4-431b-acfa-026bee9b3d99/konnectivity-agent/0.log" limit=1024